[ 532.439371] env[69255]: INFO neutron.common.config [-] Logging enabled! [ 532.439688] env[69255]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 532.439885] env[69255]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69255) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 532.440149] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 532.440257] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 532.441120] env[69255]: WARNING oslo_policy.policy [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.441389] env[69255]: WARNING oslo_policy.policy [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.442878] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] VMware NSXv3 Agent initialized successfully. [ 532.443254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] Acquiring lock "singleton_lock" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.443390] env[69255]: DEBUG oslo_concurrency.lockutils [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] Acquired lock "singleton_lock" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.443599] env[69255]: DEBUG oslo_concurrency.lockutils [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] Releasing lock "singleton_lock" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.443887] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] Full set of CONF: {{(pid=69255) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 532.444116] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ******************************************************************************** {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 532.444238] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] Configuration options gathered from: {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 532.444499] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 532.444681] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 532.444793] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ================================================================================ {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 532.444966] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] agent_down_time = 75 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.445152] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] allow_automatic_dhcp_failover = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.445362] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] allow_bulk = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.445608] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] api_extensions_path = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.445842] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] api_paste_config = api-paste.ini {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.446114] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] auth_strategy = keystone {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.446323] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] backdoor_port = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.446523] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] backdoor_socket = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.446795] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] backlog = 4096 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.447043] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.447334] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] bind_host = 0.0.0.0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.447589] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] bind_port = 9696 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.447838] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] client_socket_timeout = 900 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.448098] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] config_dir = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.448307] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.448557] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] config_source = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.448808] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] control_exchange = neutron {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.449075] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] core_plugin = ml2 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.449332] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] debug = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.449583] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] default_availability_zones = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.449956] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.450217] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] dhcp_agent_notification = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.450456] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] dhcp_agents_per_network = 1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.450694] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] dhcp_lease_duration = 86400 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.450946] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] dhcp_load_type = networks {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.451224] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] dns_domain = openstacklocal {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.451479] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.451720] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_default_route_bfd = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.451958] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_default_route_ecmp = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.452202] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_dvr = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.452424] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_new_agents = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.452647] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.452854] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_signals = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.453083] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] enable_traditional_dhcp = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.453309] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] external_dns_driver = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.453502] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] filter_validation = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.453724] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] global_physnet_mtu = 8950 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.453935] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] graceful_shutdown_timeout = 60 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.454233] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] host = cpu-1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.454447] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] host_dvr_for_dhcp = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.454649] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] http_retries = 3 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.454854] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] instance_format = [instance: %(uuid)s] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.455102] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.455296] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ipam_driver = internal {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.455494] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ipv6_pd_enabled = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.455687] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] l3_ha = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.455890] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.456122] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] l3_ha_network_physical_name = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.456355] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] l3_ha_network_type = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.456583] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_color = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.456810] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_config_append = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.457050] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.457277] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_dir = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.457500] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_file = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.457670] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_options = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.457890] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_rotate_interval = 1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.458126] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_rotate_interval_type = days {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.458352] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] log_rotation_type = none {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.458528] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.458697] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.458918] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.459153] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.459327] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.459541] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] max_dns_nameservers = 5 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.459751] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] max_header_line = 16384 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.459976] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] max_l3_agents_per_router = 3 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.460175] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] max_logfile_count = 30 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.460376] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] max_logfile_size_mb = 200 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.460570] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] max_subnet_host_routes = 20 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.460769] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] my_ip = 10.180.1.21 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.460981] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] my_ipv6 = ::1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.461197] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] network_auto_schedule = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.461390] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] network_link_prefix = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.461592] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.461796] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] notify_nova_on_port_data_changes = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.462018] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] notify_nova_on_port_status_changes = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.462217] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] pagination_max_limit = -1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.462413] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] publish_errors = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.462608] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] rate_limit_burst = 0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.462835] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] rate_limit_except_level = CRITICAL {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.463067] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] rate_limit_interval = 0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.463286] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] retry_until_window = 30 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.463498] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] router_distributed = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.463716] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] rpc_resources_processing_step = 20 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.463933] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] rpc_response_max_timeout = 600 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.464166] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] rpc_response_timeout = 60 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.464419] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] send_events_interval = 2 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.464673] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] service_plugins = ['router'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.464915] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] setproctitle = on {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.465150] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] shell_completion = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.465368] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] state_path = /opt/stack/data/neutron {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.465581] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] syslog_log_facility = LOG_USER {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.465764] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] tcp_keepidle = 600 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.465920] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] transport_url = **** {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466080] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] use_journal = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466220] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] use_json = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466361] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] use_ssl = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466496] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] use_stderr = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466645] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] use_syslog = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466781] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] vlan_qinq = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.466919] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] vlan_transparent = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.467069] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] watch_log_file = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.467213] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] wsgi_default_pool_size = 100 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.467353] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] wsgi_keep_alive = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.467499] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.467634] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] wsgi_server_debug = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.467794] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.467944] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468109] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468253] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468397] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468540] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468680] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468831] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.connection_string = messaging:// {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.468981] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.enabled = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469151] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.es_doc_type = notification {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469323] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.es_scroll_size = 10000 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469423] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.es_scroll_time = 2m {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469564] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.filter_error_trace = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469703] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.hmac_keys = **** {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469846] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.sentinel_service_name = mymaster {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.469996] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.socket_timeout = 0.1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.470148] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.trace_requests = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.470287] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler.trace_sqlalchemy = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.470443] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler_jaeger.process_tags = {} {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.470584] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.470720] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] profiler_otlp.service_name_prefix = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.470872] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.enforce_new_defaults = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.471165] env[69255]: WARNING oslo_config.cfg [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 532.471320] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.enforce_scope = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.471467] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.policy_default_rule = default {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.471621] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.471769] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.471920] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472073] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472211] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472344] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472481] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472624] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472775] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.472967] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] agent.extensions = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473082] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473232] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] service_providers.service_provider = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473391] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.default_quota = -1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473526] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473662] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_floatingip = 50 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473796] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_network = 100 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.473932] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_port = 500 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474085] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474226] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_router = 10 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474361] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_security_group = 10 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474495] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474629] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.quota_subnet = 100 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474766] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] QUOTAS.track_quota_usage = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.474921] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475095] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep.group = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475237] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep.helper_command = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475379] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475521] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep.thread_pool_size = 8 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475659] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep.user = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475806] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.475942] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_dhcp_release.group = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476107] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_dhcp_release.helper_command = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476264] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476410] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476548] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_dhcp_release.user = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476693] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476830] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_ovs_vsctl.group = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.476966] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477123] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477266] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477404] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_ovs_vsctl.user = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477545] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_namespace.capabilities = [21] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477680] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_namespace.group = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477816] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_namespace.helper_command = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.477957] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478115] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478289] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_namespace.user = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478401] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_conntrack.capabilities = [12] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478536] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_conntrack.group = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478673] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_conntrack.helper_command = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478813] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.478952] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479110] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_conntrack.user = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479242] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_link.capabilities = [12, 21] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479440] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_link.group = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479543] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_link.helper_command = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479695] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479834] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_link.thread_pool_size = 8 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.479993] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] privsep_link.user = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.480180] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.480358] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.480518] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.continue_on_failed_promotions = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.480658] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.dscp = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.480821] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.dscp_inherit = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.480979] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.force_mp_to_policy = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.481137] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.locking_coordinator_url = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.481405] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.log_agent_heartbeats = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.481470] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.logging_expire = 1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.481622] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.481770] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.481920] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.polling_interval = 240 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.482102] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.482281] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.482443] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.report_interval = 30.0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.482617] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.482783] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.482947] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483199] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.sync_skew = 60 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483274] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.synchronization_queue_size = 20 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483402] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT.use_helper_for_ns_read = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483560] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] SECURITYGROUP.enable_ipset = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483696] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] SECURITYGROUP.enable_security_group = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483841] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.483990] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.484152] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] experimental.ipv6_pd_enabled = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.484325] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.extension_drivers = ['port_security'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.484461] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.external_network_type = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.484614] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.484762] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.overlay_ip_version = 4 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.484909] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.path_mtu = 8950 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.485109] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.physical_network_mtus = {} {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.485263] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.485413] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.485563] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ml2.type_drivers = ['vlan'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.485716] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.485859] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486031] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486186] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486343] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486489] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486638] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486784] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.486930] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.487155] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.487314] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_login_password = **** {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.487467] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.487612] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_login_user = admin {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.487760] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.487910] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488066] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488257] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488359] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488509] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488683] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488804] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.488944] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.489106] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.489263] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.489408] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.489575] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.489757] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.489909] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490067] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490215] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490362] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.auth_section = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490514] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.auth_type = password {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490659] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490797] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.certfile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.490940] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.collect_timing = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491103] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.endpoint_type = public {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491249] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.insecure = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491386] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.keyfile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491533] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.region_name = RegionOne {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491674] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.split_loggers = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491812] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] nova.timeout = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.491955] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.auth_section = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492114] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.auth_type = password {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492263] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492398] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.certfile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492535] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.collect_timing = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492679] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.endpoint_type = public {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492816] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.insecure = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.492978] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.keyfile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493129] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.region_name = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493389] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.split_loggers = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493389] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] placement.timeout = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493554] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.auth_section = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493771] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.auth_type = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493872] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.cafile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.493950] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.certfile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494085] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.collect_timing = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494247] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.connect_retries = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494347] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.connect_retry_delay = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494487] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.enable_notifications = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494619] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.endpoint_override = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494753] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.insecure = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.494928] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.interface = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495053] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.keyfile = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495185] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.max_version = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495328] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.min_version = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495463] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.region_name = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495598] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.retriable_status_codes = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495731] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.service_name = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.495864] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.service_type = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496012] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.split_loggers = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496155] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.status_code_retries = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496289] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.status_code_retry_delay = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496423] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.timeout = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496556] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.valid_interfaces = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496687] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ironic.version = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496829] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] cli_script.dry_run = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.496981] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497135] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497278] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497439] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497606] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497721] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497855] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.497995] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.498153] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.498304] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.498443] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.498594] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.498743] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.498893] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499043] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499197] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499342] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499480] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499717] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499771] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.499892] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500048] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500196] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500337] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500475] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500613] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500751] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.500953] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501054] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501165] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501307] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.ssl = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501459] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501602] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501743] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.501890] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502048] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502200] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502698] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_notifications.driver = [] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502698] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502698] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502853] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.502885] env[69255]: DEBUG oslo_service.backend.eventlet.service [None req-6559167f-24b7-4e2d-9d6f-c802ddd5f1c6 None None] ******************************************************************************** {{(pid=69255) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 532.503992] env[69255]: DEBUG neutron.agent.securitygroups_rpc [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Init firewall settings (driver=nsxv3) {{(pid=69255) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 532.505325] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69255) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 532.505564] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] RPC agent_id: nsxm-l-01a.corp.local [ 532.507929] env[69255]: DEBUG dogpile.cache.region [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 532.508066] env[69255]: DEBUG dogpile.lock [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 532.508171] env[69255]: DEBUG dogpile.lock [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 532.508273] env[69255]: DEBUG dogpile.lock [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 532.508374] env[69255]: DEBUG dogpile.cache.region [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 532.508466] env[69255]: DEBUG dogpile.lock [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 532.509411] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 532.541755] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Session token - acquiring [ 532.543394] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.543555] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.543678] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.544142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.555499] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.864702] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 532.888759] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 532.888908] env[69255]: DEBUG dogpile.cache.region [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Cache value generated in 0.380 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 532.889062] env[69255]: DEBUG dogpile.lock [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 532.889169] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Activating Policy API Provider. [ 532.889394] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Looking for the default Infrastructure Rules. [ 532.959198] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Looking for the Default Layer3 Logged Drop Section. [ 532.974724] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 532.975286] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.975521] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.975628] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.975914] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.976536] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.492958] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.996534] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.500465] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Inventory metadata is going to be refreshed. [ 534.500465] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 535.324019] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.324019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.324019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.324019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.444542] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 535.445889] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.447046] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 535.464822] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.465383] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.465597] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.466120] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.466400] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.466654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 535.466890] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.467121] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 535.488762] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.491017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.491017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.491017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.491017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.491017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 535.511650] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.512356] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.512586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.513046] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.513316] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.513580] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 535.536625] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.537108] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.538065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.538065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.538065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.538065] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 535.538257] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.538257] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 535.558481] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.558711] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.558751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.559087] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.559275] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.559500] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 535.559690] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.559833] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 535.580513] env[69255]: DEBUG networking_nsxv3.common.locking [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.580731] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.580864] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.581104] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.581257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.581412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 535.581521] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.581626] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Inventory metadata have been refreshed. [ 535.581726] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Dryrun:True. Metadata refresh completed. [ 535.581942] env[69255]: DEBUG oslo_concurrency.lockutils [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Releasing lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.583842] env[69255]: INFO neutron.agent.agent_extensions_manager [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Loaded agent extensions: [] [ 535.584574] env[69255]: DEBUG neutron_lib.callbacks.manager [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69255) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 535.640079] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent RPC Daemon Started! [ 535.640288] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:0 started [ 535.640349] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent out of sync with plugin! [ 540.585070] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.585520] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.586443] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.586808] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.078251] env[69255]: INFO networking_nsxv3.common.synchronization [None req-90b11893-e8cb-47c4-af8d-4883ac14a160 demo admin] Enqueued Resource ID: e9d3b895-e23b-4b4d-ace7-94444d830b65 with Priority: HIGHEST for action security_group_rules [ 550.078859] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d3b895-e23b-4b4d-ace7-94444d830b65 with Priority: HIGHEST for action security_group_rules [ 550.079184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9d3b895-e23b-4b4d-ace7-94444d830b65 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.079330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9d3b895-e23b-4b4d-ace7-94444d830b65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.079398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9d3b895-e23b-4b4d-ace7-94444d830b65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.079753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9d3b895-e23b-4b4d-ace7-94444d830b65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.079841] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9d3b895-e23b-4b4d-ace7-94444d830b65',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.600868] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.601114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.601114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.601297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.601395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.601490] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9d3b895-e23b-4b4d-ace7-94444d830b65 already deleted. [ 550.601575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9d3b895-e23b-4b4d-ace7-94444d830b65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.080454] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.080454] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.082207] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.082489] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.083494] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.083494] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.084081] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.084624] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.085349] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.085752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 577.589262] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.589262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.589262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.589262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.589262] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.678213] env[69255]: INFO networking_nsxv3.common.synchronization [None req-4ac278a0-88dd-4652-ba5d-680e0b7f5b18 None None] Enqueued Resource ID: 48383ce4-8088-4888-8437-ee028d5b7e2c with Priority: HIGHEST for action port [ 577.678213] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48383ce4-8088-4888-8437-ee028d5b7e2c with Priority: HIGHEST for action port [ 577.679606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-48383ce4-8088-4888-8437-ee028d5b7e2c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.679606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48383ce4-8088-4888-8437-ee028d5b7e2c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.679606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48383ce4-8088-4888-8437-ee028d5b7e2c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.680669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48383ce4-8088-4888-8437-ee028d5b7e2c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.680669] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48383ce4-8088-4888-8437-ee028d5b7e2c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.091351] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.184495] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48383ce4-8088-4888-8437-ee028d5b7e2c [ 578.184763] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.184910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.185031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.185237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.185335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.185432] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48383ce4-8088-4888-8437-ee028d5b7e2c already deleted. [ 578.185513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48383ce4-8088-4888-8437-ee028d5b7e2c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.595153] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.098708] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 579.098708] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 579.734702] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a3e5ed8b-ae15-46b1-964b-8edb81be4016 None None] Enqueued Resource ID: b4402a89-efc2-4931-8af1-37d3936281c0 with Priority: HIGHEST for action port [ 579.735366] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4402a89-efc2-4931-8af1-37d3936281c0 with Priority: HIGHEST for action port [ 579.735738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4402a89-efc2-4931-8af1-37d3936281c0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.736930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4402a89-efc2-4931-8af1-37d3936281c0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.737035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4402a89-efc2-4931-8af1-37d3936281c0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.737329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4402a89-efc2-4931-8af1-37d3936281c0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.737432] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4402a89-efc2-4931-8af1-37d3936281c0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.875730] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.875833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.876609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.877039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.893890] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 579.895334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.897545] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 579.917093] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.917249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.917320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.918164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.918164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.918164] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 579.918164] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 579.918164] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 579.940930] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.941134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.941225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.941595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.941796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.942740] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 579.969531] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.969722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.969924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.970728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.970953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.971149] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 579.996361] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.996361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.996361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.996361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.996361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.996361] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 579.996361] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 579.996361] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 580.015386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.015700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.015700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.015816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.015906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.016026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 580.016317] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.016317] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 580.036913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.037265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.037265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.037414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.037450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.037600] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 580.038043] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.038297] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 580.038297] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 580.038357] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 580.038436] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 580.038479] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 580.038739] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 580.038817] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 580.039446] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 580.062490] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.062644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.062826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.062925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.063023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.063152] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 580.088388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.088540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.088613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.088828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.088958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.101853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.240466] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4402a89-efc2-4931-8af1-37d3936281c0 [ 580.240466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.240466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.240466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.240466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.240466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.240466] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4402a89-efc2-4931-8af1-37d3936281c0 already deleted. [ 580.240466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4402a89-efc2-4931-8af1-37d3936281c0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.483204] env[69255]: INFO networking_nsxv3.common.synchronization [None req-cd0b5c9a-3562-4ae5-8a83-4115cb98bbc4 None None] Enqueued Resource ID: 72579e77-fbe5-4eee-a4de-4dfe83a5b325 with Priority: HIGHEST for action port [ 580.483744] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72579e77-fbe5-4eee-a4de-4dfe83a5b325 with Priority: HIGHEST for action port [ 580.484945] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-72579e77-fbe5-4eee-a4de-4dfe83a5b325 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.485133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72579e77-fbe5-4eee-a4de-4dfe83a5b325" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.485168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72579e77-fbe5-4eee-a4de-4dfe83a5b325" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.485433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72579e77-fbe5-4eee-a4de-4dfe83a5b325" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.485499] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72579e77-fbe5-4eee-a4de-4dfe83a5b325',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.923918] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7256c142-2944-4a4d-8dd3-65a57a160fc5 None None] Enqueued Resource ID: 92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681 with Priority: HIGHEST for action port [ 580.924337] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681 with Priority: HIGHEST for action port [ 580.924750] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.924881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.924945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.925200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.925290] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.991031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72579e77-fbe5-4eee-a4de-4dfe83a5b325 [ 580.991031] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.991031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.991031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.991031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.991334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.991334] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72579e77-fbe5-4eee-a4de-4dfe83a5b325 already deleted. [ 580.991400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72579e77-fbe5-4eee-a4de-4dfe83a5b325" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.331292] env[69255]: INFO networking_nsxv3.common.synchronization [None req-0b80d255-e10d-41de-8c6b-1b5fbca0c908 None None] Enqueued Resource ID: 0fbdc5fd-99c7-4335-a5a9-4726eee0e05f with Priority: HIGHEST for action port [ 581.331558] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbdc5fd-99c7-4335-a5a9-4726eee0e05f with Priority: HIGHEST for action port [ 581.332203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fbdc5fd-99c7-4335-a5a9-4726eee0e05f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.332270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fbdc5fd-99c7-4335-a5a9-4726eee0e05f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.333019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fbdc5fd-99c7-4335-a5a9-4726eee0e05f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.333019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fbdc5fd-99c7-4335-a5a9-4726eee0e05f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.333019] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fbdc5fd-99c7-4335-a5a9-4726eee0e05f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.427156] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681 [ 581.427431] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.429070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.429070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.429070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.429070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.429070] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681 already deleted. [ 581.429070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92e7cb5a-2cdf-4c1c-82ca-4c4ffd25f681" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.837151] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fbdc5fd-99c7-4335-a5a9-4726eee0e05f [ 581.837442] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.837512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.838042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.838042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.838042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.838042] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fbdc5fd-99c7-4335-a5a9-4726eee0e05f already deleted. [ 581.838042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fbdc5fd-99c7-4335-a5a9-4726eee0e05f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.852306] env[69255]: INFO networking_nsxv3.common.synchronization [None req-910d73fc-4930-474f-b2b7-d827585f05e5 None None] Enqueued Resource ID: c78c938f-de54-4383-8dc7-abc165b718ca with Priority: HIGHEST for action port [ 581.852482] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c78c938f-de54-4383-8dc7-abc165b718ca with Priority: HIGHEST for action port [ 581.853202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c78c938f-de54-4383-8dc7-abc165b718ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.853202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c78c938f-de54-4383-8dc7-abc165b718ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.853405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c78c938f-de54-4383-8dc7-abc165b718ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.853537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c78c938f-de54-4383-8dc7-abc165b718ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.853566] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c78c938f-de54-4383-8dc7-abc165b718ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.152350] env[69255]: INFO networking_nsxv3.common.synchronization [None req-730826a3-b031-4a63-8a75-47aac5cc4a6e None None] Enqueued Resource ID: 257c1028-7773-492b-8ab8-1e8bf6a2f33e with Priority: HIGHEST for action port [ 582.152619] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 257c1028-7773-492b-8ab8-1e8bf6a2f33e with Priority: HIGHEST for action port [ 582.153339] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-257c1028-7773-492b-8ab8-1e8bf6a2f33e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.153339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-257c1028-7773-492b-8ab8-1e8bf6a2f33e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.153483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-257c1028-7773-492b-8ab8-1e8bf6a2f33e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.153667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-257c1028-7773-492b-8ab8-1e8bf6a2f33e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.153773] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('257c1028-7773-492b-8ab8-1e8bf6a2f33e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.355687] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c78c938f-de54-4383-8dc7-abc165b718ca [ 582.355993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.356223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.356295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.356524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.356629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.356727] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c78c938f-de54-4383-8dc7-abc165b718ca already deleted. [ 582.356868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c78c938f-de54-4383-8dc7-abc165b718ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.656833] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 257c1028-7773-492b-8ab8-1e8bf6a2f33e [ 582.656833] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.656833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.656833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.656833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.656833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.656833] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:257c1028-7773-492b-8ab8-1e8bf6a2f33e already deleted. [ 582.656833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-257c1028-7773-492b-8ab8-1e8bf6a2f33e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.066779] env[69255]: INFO networking_nsxv3.common.synchronization [None req-1c0cfadd-42c5-47fc-b61c-38f1c78aefa9 None None] Enqueued Resource ID: 2bffadf6-a9a9-4029-9a54-8b6b443cc515 with Priority: HIGHEST for action port [ 584.067133] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bffadf6-a9a9-4029-9a54-8b6b443cc515 with Priority: HIGHEST for action port [ 584.067606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bffadf6-a9a9-4029-9a54-8b6b443cc515 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.067794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bffadf6-a9a9-4029-9a54-8b6b443cc515" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.067794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bffadf6-a9a9-4029-9a54-8b6b443cc515" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.070789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bffadf6-a9a9-4029-9a54-8b6b443cc515" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.070789] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bffadf6-a9a9-4029-9a54-8b6b443cc515',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.245899] env[69255]: INFO networking_nsxv3.common.synchronization [None req-bb1f9861-5172-41a4-a34f-b5fa6b9135e0 None None] Enqueued Resource ID: 92387f2e-ebdd-4503-b958-ea3e443f2cab with Priority: HIGHEST for action port [ 584.246181] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92387f2e-ebdd-4503-b958-ea3e443f2cab with Priority: HIGHEST for action port [ 584.250872] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-92387f2e-ebdd-4503-b958-ea3e443f2cab taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.250872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92387f2e-ebdd-4503-b958-ea3e443f2cab" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.250872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92387f2e-ebdd-4503-b958-ea3e443f2cab" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.251204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92387f2e-ebdd-4503-b958-ea3e443f2cab" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.251204] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92387f2e-ebdd-4503-b958-ea3e443f2cab',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.571165] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bffadf6-a9a9-4029-9a54-8b6b443cc515 [ 584.571353] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.571486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.571553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.571786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.571875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.571969] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bffadf6-a9a9-4029-9a54-8b6b443cc515 already deleted. [ 584.572060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bffadf6-a9a9-4029-9a54-8b6b443cc515" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.753454] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92387f2e-ebdd-4503-b958-ea3e443f2cab [ 584.756635] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.756635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.756635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.756635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.756635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.756635] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92387f2e-ebdd-4503-b958-ea3e443f2cab already deleted. [ 584.756635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92387f2e-ebdd-4503-b958-ea3e443f2cab" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.778746] env[69255]: INFO networking_nsxv3.common.synchronization [None req-0f1c2ea0-8812-445a-af3a-fe833cf86d9a tempest-ServersTestJSON-447164745 tempest-ServersTestJSON-447164745-project-member] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_rules [ 584.779347] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_rules [ 584.779654] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.779775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.779841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.781348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.781442] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.877123] env[69255]: INFO networking_nsxv3.common.synchronization [None req-35377bf0-17b7-4ab2-b240-c4608ddbe15e tempest-ServersTestJSON-447164745 tempest-ServersTestJSON-447164745-project-member] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_rules [ 584.877578] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_rules [ 584.878501] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.878501] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.086222] env[69255]: INFO networking_nsxv3.common.synchronization [None req-45d9d1af-e559-4fc5-8ba4-4c436e9d7c2f None None] Enqueued Resource ID: e9395bf2-29b8-45f0-a1d5-d7d968707995 with Priority: HIGHEST for action port [ 585.086519] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9395bf2-29b8-45f0-a1d5-d7d968707995 with Priority: HIGHEST for action port [ 585.087100] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9395bf2-29b8-45f0-a1d5-d7d968707995 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.087235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9395bf2-29b8-45f0-a1d5-d7d968707995" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.087329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9395bf2-29b8-45f0-a1d5-d7d968707995" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.087991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9395bf2-29b8-45f0-a1d5-d7d968707995" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.087991] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9395bf2-29b8-45f0-a1d5-d7d968707995',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.306317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.308054] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 already deleted. [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.308054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.308054] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.593240] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9395bf2-29b8-45f0-a1d5-d7d968707995 [ 585.593475] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.593612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.593717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.593953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.594028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.594103] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9395bf2-29b8-45f0-a1d5-d7d968707995 already deleted. [ 585.594186] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9395bf2-29b8-45f0-a1d5-d7d968707995" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.829489] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.829715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.829715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.829873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.830054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.830174] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 already deleted. [ 585.830267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.750190] env[69255]: INFO networking_nsxv3.common.synchronization [None req-8cb7b8c8-3ae8-4556-a776-0da3bcc1d48b None None] Enqueued Resource ID: 2df9b046-e61b-4645-9fc6-19cf1aee4b6c with Priority: HIGHEST for action port [ 586.750190] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df9b046-e61b-4645-9fc6-19cf1aee4b6c with Priority: HIGHEST for action port [ 586.750190] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2df9b046-e61b-4645-9fc6-19cf1aee4b6c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.750190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2df9b046-e61b-4645-9fc6-19cf1aee4b6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.750190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2df9b046-e61b-4645-9fc6-19cf1aee4b6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.750190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2df9b046-e61b-4645-9fc6-19cf1aee4b6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.750190] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2df9b046-e61b-4645-9fc6-19cf1aee4b6c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.756512] env[69255]: INFO networking_nsxv3.common.synchronization [None req-fd1bcdb6-33b3-4438-bfe3-352bcfaf1d16 None None] Enqueued Resource ID: eddc29fd-d261-4648-a76e-b65c257c310e with Priority: HIGHEST for action port [ 586.757576] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eddc29fd-d261-4648-a76e-b65c257c310e with Priority: HIGHEST for action port [ 586.760407] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-eddc29fd-d261-4648-a76e-b65c257c310e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.760407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eddc29fd-d261-4648-a76e-b65c257c310e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.760625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eddc29fd-d261-4648-a76e-b65c257c310e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.760709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eddc29fd-d261-4648-a76e-b65c257c310e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.760783] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eddc29fd-d261-4648-a76e-b65c257c310e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.255694] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2df9b046-e61b-4645-9fc6-19cf1aee4b6c [ 587.255978] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.256172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.256245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.256456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.256549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.256644] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2df9b046-e61b-4645-9fc6-19cf1aee4b6c already deleted. [ 587.256726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2df9b046-e61b-4645-9fc6-19cf1aee4b6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.264191] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eddc29fd-d261-4648-a76e-b65c257c310e [ 587.264383] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.264509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.264576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.264776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.265575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.265575] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eddc29fd-d261-4648-a76e-b65c257c310e already deleted. [ 587.265575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eddc29fd-d261-4648-a76e-b65c257c310e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.596990] env[69255]: INFO networking_nsxv3.common.synchronization [None req-89660393-1db9-494e-a47a-93a07dbc42a4 None None] Enqueued Resource ID: 6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02 with Priority: HIGHEST for action port [ 590.599480] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02 with Priority: HIGHEST for action port [ 590.600931] env[69255]: INFO networking_nsxv3.common.synchronization [req-46b2c43b-e142-44b6-bb7b-5e4a5189cdce req-d20c1572-275a-4147-a8f8-081a3a297105 tempest-DeleteServersAdminTestJSON-1197380853 tempest-DeleteServersAdminTestJSON-1197380853-project-member] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 590.601679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.602732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.602895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.603280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.603615] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.608592] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 590.610917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.610917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.610917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.610917] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.642078] env[69255]: INFO networking_nsxv3.common.synchronization [None req-11f154c8-69a6-4508-a968-38a5c223935a None None] Enqueued Resource ID: 6a5b816f-e96f-47f7-af18-caeea0ef6876 with Priority: HIGHEST for action port [ 590.642351] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a5b816f-e96f-47f7-af18-caeea0ef6876 with Priority: HIGHEST for action port [ 590.643038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a5b816f-e96f-47f7-af18-caeea0ef6876 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.643184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a5b816f-e96f-47f7-af18-caeea0ef6876" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.643256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a5b816f-e96f-47f7-af18-caeea0ef6876" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.643499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a5b816f-e96f-47f7-af18-caeea0ef6876" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.643587] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a5b816f-e96f-47f7-af18-caeea0ef6876',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.113577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02 [ 591.113747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.113833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.115952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.116223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.116325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.116430] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02 already deleted. [ 591.116514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bc4ab2f-9ca2-4c7e-a95d-6040722c4b02" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.134490] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.134673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.134716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.134919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.135018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.135208] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.135305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.135362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.135509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.135585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.135671] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a already deleted. [ 591.135730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.147579] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a5b816f-e96f-47f7-af18-caeea0ef6876 [ 591.148142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.148142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.148142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.148301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.148301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.149288] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a5b816f-e96f-47f7-af18-caeea0ef6876 already deleted. [ 591.149288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a5b816f-e96f-47f7-af18-caeea0ef6876" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.591196] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.591196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.591196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.591196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.592211] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.592705] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.593052] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.593417] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.594709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.596032] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.596114] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.596423] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.596796] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.596934] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.597126] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.597374] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.621256] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.621431] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 591.621665] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.621751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.622066] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-0301e466-cf4c-40ab-b059-2d23bcc08b85 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.622305] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.622368] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.622707] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.622984] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0301e466-cf4c-40ab-b059-2d23bcc08b85',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.866084] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a36797d1-d86a-4cdf-a9a9-3f774b918796 None None] Enqueued Resource ID: 6eb2a870-9f8b-4464-a708-7b9e47284b42 with Priority: HIGHEST for action port [ 591.866781] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb2a870-9f8b-4464-a708-7b9e47284b42 with Priority: HIGHEST for action port [ 591.867305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb2a870-9f8b-4464-a708-7b9e47284b42 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.868023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb2a870-9f8b-4464-a708-7b9e47284b42" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.868023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb2a870-9f8b-4464-a708-7b9e47284b42" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.868740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb2a870-9f8b-4464-a708-7b9e47284b42" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.868815] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb2a870-9f8b-4464-a708-7b9e47284b42',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.127185] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.127185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.127185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.127185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.127185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.127185] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 0301e466-cf4c-40ab-b059-2d23bcc08b85 not found, creating... [ 592.127884] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.128246] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.128474] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.128808] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.129070] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.129553] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.129888] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.130122] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.130441] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.130821] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.133022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 0301e466-cf4c-40ab-b059-2d23bcc08b85 is going to be created. [ 592.158360] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.158360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.158360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.158360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.158360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.158360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.373388] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eb2a870-9f8b-4464-a708-7b9e47284b42 [ 592.373388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.373614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.373757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.374727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.374727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.374727] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eb2a870-9f8b-4464-a708-7b9e47284b42 already deleted. [ 592.375813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb2a870-9f8b-4464-a708-7b9e47284b42" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.433033] env[69255]: INFO networking_nsxv3.common.synchronization [req-ff484bd0-9fc9-4e57-ae5d-e01ef50b056e req-9cbcce6c-116e-47cb-aa21-5cbe37ad030a tempest-ServersAdminNegativeTestJSON-361636345 tempest-ServersAdminNegativeTestJSON-361636345-project-member] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 592.433942] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 592.434400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.434594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.434730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.435120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.435394] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.435570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.435761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.435963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.436300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.436550] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.939979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.940350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.940350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.940466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.940598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.940831] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.940940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.941013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.941189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.941290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.941405] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 already deleted. [ 592.941493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.299967] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.299967] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.300091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.301485] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.301868] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.302119] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.302279] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.302560] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.302965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.303286] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.303461] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.303608] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.303747] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.303889] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.304055] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.304204] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.326588] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.326760] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 593.326910] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.327109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.327422] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-cbb1d3d2-da10-484e-8626-288875cff763 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.327601] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.327725] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.328910] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.329147] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbb1d3d2-da10-484e-8626-288875cff763',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.503200] env[69255]: INFO networking_nsxv3.common.synchronization [req-46b2c43b-e142-44b6-bb7b-5e4a5189cdce req-9d6e9f09-e382-427f-b248-2a9e93397664 service nova] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_rules [ 593.503552] env[69255]: INFO networking_nsxv3.common.synchronization [req-46b2c43b-e142-44b6-bb7b-5e4a5189cdce req-9d6e9f09-e382-427f-b248-2a9e93397664 service nova] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 593.503761] env[69255]: INFO networking_nsxv3.common.synchronization [req-46b2c43b-e142-44b6-bb7b-5e4a5189cdce req-9d6e9f09-e382-427f-b248-2a9e93397664 service nova] Enqueued Resource ID: 0301e466-cf4c-40ab-b059-2d23bcc08b85 with Priority: HIGHEST for action port [ 593.504380] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_rules [ 593.504578] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 593.504706] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0301e466-cf4c-40ab-b059-2d23bcc08b85 with Priority: HIGHEST for action port [ 593.505241] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.505241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.505371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.505725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.505725] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.508443] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.508443] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.508443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.508443] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.510789] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-0301e466-cf4c-40ab-b059-2d23bcc08b85 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.511254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.511454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.511744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.512853] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0301e466-cf4c-40ab-b059-2d23bcc08b85',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.833109] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.833407] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.834182] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.834483] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.834645] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.834809] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port cbb1d3d2-da10-484e-8626-288875cff763 not found, creating... [ 593.835094] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.835254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.835373] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.836046] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.836046] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.836747] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.836928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.837249] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.837297] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.837629] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.837629] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: cbb1d3d2-da10-484e-8626-288875cff763 is going to be created. [ 593.859295] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.859606] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.859766] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.860054] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.860964] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.860964] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.018526] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.018826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.018878] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.034728] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0301e466-cf4c-40ab-b059-2d23bcc08b85 with status ACTIVE [ 594.035374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.036163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.036163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.036163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.036586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.036586] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.036586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.036696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.037137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.037137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.037137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.037541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.037541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.037541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.037541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.037667] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0301e466-cf4c-40ab-b059-2d23bcc08b85 is going to be updated. [ 594.059698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.059903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.059903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.060231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.060425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.060685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0301e466-cf4c-40ab-b059-2d23bcc08b85" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.203160] env[69255]: INFO networking_nsxv3.common.synchronization [req-2040d239-6765-4c7a-8253-4231deae6617 req-a2a7905b-b7a2-458a-ad12-3b0fcdaa34bd tempest-FloatingIPsAssociationTestJSON-1412388345 tempest-FloatingIPsAssociationTestJSON-1412388345-project-member] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 594.203160] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 594.203160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.204930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.205081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.205413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.205612] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.205725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.205792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.205970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.206071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.206186] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.344814] env[69255]: INFO networking_nsxv3.common.synchronization [None req-eebcede0-81f5-4b0e-8e9c-c87f19171d24 None None] Enqueued Resource ID: eef6912b-5f5e-4bdb-a487-0c1c411b2d82 with Priority: HIGHEST for action port [ 594.344814] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eef6912b-5f5e-4bdb-a487-0c1c411b2d82 with Priority: HIGHEST for action port [ 594.344814] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-eef6912b-5f5e-4bdb-a487-0c1c411b2d82 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.345188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eef6912b-5f5e-4bdb-a487-0c1c411b2d82" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.345188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eef6912b-5f5e-4bdb-a487-0c1c411b2d82" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.346823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eef6912b-5f5e-4bdb-a487-0c1c411b2d82" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.346910] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eef6912b-5f5e-4bdb-a487-0c1c411b2d82',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.523152] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.710107] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.710340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.710340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.710559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.710695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.710849] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.710949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.711488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.711488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.711488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.711488] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee already deleted. [ 594.711488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.795945] env[69255]: INFO networking_nsxv3.common.synchronization [req-ff484bd0-9fc9-4e57-ae5d-e01ef50b056e req-ec1af5c3-e074-44dc-9426-2e3c4c278388 service nova] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_rules [ 594.796111] env[69255]: INFO networking_nsxv3.common.synchronization [req-ff484bd0-9fc9-4e57-ae5d-e01ef50b056e req-ec1af5c3-e074-44dc-9426-2e3c4c278388 service nova] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 594.796255] env[69255]: INFO networking_nsxv3.common.synchronization [req-ff484bd0-9fc9-4e57-ae5d-e01ef50b056e req-ec1af5c3-e074-44dc-9426-2e3c4c278388 service nova] Enqueued Resource ID: cbb1d3d2-da10-484e-8626-288875cff763 with Priority: HIGHEST for action port [ 594.796522] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_rules [ 594.796600] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 594.796698] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb1d3d2-da10-484e-8626-288875cff763 with Priority: HIGHEST for action port [ 594.799406] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.799406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.799406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.799406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.799406] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.799889] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.800040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.800130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.800461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.800559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.800656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.800716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.800864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.801017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.801072] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.803380] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbb1d3d2-da10-484e-8626-288875cff763 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.803477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.803513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.803647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.803726] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbb1d3d2-da10-484e-8626-288875cff763',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.849234] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eef6912b-5f5e-4bdb-a487-0c1c411b2d82 [ 594.849451] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.849580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.849782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.850013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.850163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.850207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eef6912b-5f5e-4bdb-a487-0c1c411b2d82 already deleted. [ 594.850416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eef6912b-5f5e-4bdb-a487-0c1c411b2d82" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.026201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.026576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.026576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.026683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.026742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.026845] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be created. [ 595.059964] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.060102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.060334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.060385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.060506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.073585] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: UNINITIALIZED for 2s [ 595.125585] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.125585] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.125585] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.126494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.126494] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.126494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.126494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.126730] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.126730] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.126972] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.128168] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.128168] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.128168] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.128168] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.128168] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.128168] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.153024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.153024] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 595.153024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.153024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.153024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-131e862c-e97c-47ae-9ec6-833569c21576 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.153024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.153024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.153024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.153024] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('131e862c-e97c-47ae-9ec6-833569c21576',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.307598] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.307719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.308162] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.309330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbb1d3d2-da10-484e-8626-288875cff763 with status ACTIVE [ 595.309330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.309330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.309330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.309581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.309581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.312961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.312961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.312961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.312961] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbb1d3d2-da10-484e-8626-288875cff763 is going to be updated. [ 595.337332] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.337530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.337625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.337816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.337955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.338136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbb1d3d2-da10-484e-8626-288875cff763" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.655224] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.655446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.655568] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.655848] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.657206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.657206] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 131e862c-e97c-47ae-9ec6-833569c21576 not found, creating... [ 595.657206] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.657206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.657206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.657206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.657206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.658280] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.658280] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.658280] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.658280] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.658280] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.658280] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 131e862c-e97c-47ae-9ec6-833569c21576 is going to be created. [ 595.679546] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.679664] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.679894] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.680078] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.680352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.680541] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.813279] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.316452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.316847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.316847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.316948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.316994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.317497] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be created. [ 596.342496] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.342703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.342703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.343671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.343880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.357096] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: UNINITIALIZED for 2s [ 596.829720] env[69255]: INFO networking_nsxv3.common.synchronization [req-2040d239-6765-4c7a-8253-4231deae6617 req-6bdfdd61-7810-4fb0-a430-a0afcb80aa0e service nova] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_rules [ 596.830403] env[69255]: INFO networking_nsxv3.common.synchronization [req-2040d239-6765-4c7a-8253-4231deae6617 req-6bdfdd61-7810-4fb0-a430-a0afcb80aa0e service nova] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 596.830403] env[69255]: INFO networking_nsxv3.common.synchronization [req-2040d239-6765-4c7a-8253-4231deae6617 req-6bdfdd61-7810-4fb0-a430-a0afcb80aa0e service nova] Enqueued Resource ID: 131e862c-e97c-47ae-9ec6-833569c21576 with Priority: HIGHEST for action port [ 596.830894] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_rules [ 596.833551] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 596.833551] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 131e862c-e97c-47ae-9ec6-833569c21576 with Priority: HIGHEST for action port [ 596.833551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.833551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.833551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.833551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.833551] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.835704] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.835910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.836285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.836603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.836726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.836841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.836909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.837104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.837273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.837273] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.838606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-131e862c-e97c-47ae-9ec6-833569c21576 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.839231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.839231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.839231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.839373] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('131e862c-e97c-47ae-9ec6-833569c21576',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.901928] env[69255]: INFO networking_nsxv3.common.synchronization [None req-68e5ad69-2887-47c7-9c35-92f55164292b tempest-VolumesAssistedSnapshotsTest-1320610663 tempest-VolumesAssistedSnapshotsTest-1320610663-project-member] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_rules [ 596.902529] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_rules [ 596.904846] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.904846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.904846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.904846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.904846] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.085024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 597.085642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.086102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.086260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.086571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.086758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.087267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.087570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.088052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.088052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.088217] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.158828] env[69255]: INFO networking_nsxv3.common.synchronization [None req-61840348-ddec-471f-a1fc-048e83468181 tempest-VolumesAssistedSnapshotsTest-1320610663 tempest-VolumesAssistedSnapshotsTest-1320610663-project-member] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_rules [ 597.159369] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_rules [ 597.159741] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.159799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.342389] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.344758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.344758] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.344758] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 131e862c-e97c-47ae-9ec6-833569c21576 with status ACTIVE [ 597.344758] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.344758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.344758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.345266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.345266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.345266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.345373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.346034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.346034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.346034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.346034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.346275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.346275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.346376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.346376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.346439] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 131e862c-e97c-47ae-9ec6-833569c21576 is going to be updated. [ 597.371950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.372171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.372256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.372490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.372764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.372957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-131e862c-e97c-47ae-9ec6-833569c21576" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.433466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.433466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.433466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.433849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.435218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.435218] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 already deleted. [ 597.435218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.435218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.439024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.439024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.583407] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d7ff97f9-68b4-4910-a8da-30f17b9a2d79 None None] Enqueued Resource ID: 4ed547d1-bbc0-41e4-830d-f1d6dda6a5de with Priority: HIGHEST for action port [ 597.583407] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ed547d1-bbc0-41e4-830d-f1d6dda6a5de with Priority: HIGHEST for action port [ 597.583407] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ed547d1-bbc0-41e4-830d-f1d6dda6a5de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.583407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ed547d1-bbc0-41e4-830d-f1d6dda6a5de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.583407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ed547d1-bbc0-41e4-830d-f1d6dda6a5de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.583407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ed547d1-bbc0-41e4-830d-f1d6dda6a5de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.583407] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed547d1-bbc0-41e4-830d-f1d6dda6a5de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.591174] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.591174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.591174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.591399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.591558] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.591655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.591715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.591874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.591943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.592046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.592191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.592279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.592337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.592473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.592603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.592687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.592750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.594608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.594608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.594608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.594608] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.849644] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.962952] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.963112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.963169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.963350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.963459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.963633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 already deleted. [ 597.963633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.085926] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ed547d1-bbc0-41e4-830d-f1d6dda6a5de [ 598.085926] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.085926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.085926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.085926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.086336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.086336] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ed547d1-bbc0-41e4-830d-f1d6dda6a5de already deleted. [ 598.086336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ed547d1-bbc0-41e4-830d-f1d6dda6a5de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.097171] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a: rpc.has_security_group_logging(os_id): False [ 598.115409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.115555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.115630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.115853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.115978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.116180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.116299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.116354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.116490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.116568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.116752] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.116847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.116910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.117070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.117143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.117323] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.117416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.117479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.117660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.117783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.117915] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be created. [ 598.191415] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.191415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.191415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.191664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.191932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.207726] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: IN_PROGRESS for 2s [ 598.354248] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.355127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.355127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.355127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.355127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.355127] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be created. [ 598.375173] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 598.375173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.375355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.375563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.375807] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.375864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.375932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.376124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.376414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.376414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.376414] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.385373] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.385529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.385657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.385949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.386135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.398998] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: UNINITIALIZED for 2s [ 598.880191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.880348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.880438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.880687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.880831] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.880935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.880997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.881165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.881253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.881342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.881483] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.881588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.881645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.881785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.881922] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.882019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.882077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.882214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.882290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.882369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.882458] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.384274] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315: rpc.has_security_group_logging(os_id): False [ 599.404833] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.404833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.404833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.405336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.405433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.405657] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.405763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.405849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.406057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.406141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.406333] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.406708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.406847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.407053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.407145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.407422] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.407422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.407498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.407632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.407720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.407955] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be created. [ 599.471361] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.471361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.471361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.471361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.471570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.493564] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: IN_PROGRESS for 2s [ 600.057826] env[69255]: INFO networking_nsxv3.common.synchronization [req-4012e6d6-e127-495b-8f89-6c07bbd2a1e6 req-ccac3065-95c9-400b-b59d-ef8e7fc6125f tempest-ServerExternalEventsTest-1427679875 tempest-ServerExternalEventsTest-1427679875-project-member] Enqueued Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_members [ 600.057826] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_members [ 600.057826] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.057826] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.057826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.057826] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.199241] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ee35cb12-2027-4ee8-96c3-ff5e7a1ee709 None None] Enqueued Resource ID: 8a03288e-9e43-4c2f-bfdc-36058471165c with Priority: HIGHEST for action port [ 600.199492] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a03288e-9e43-4c2f-bfdc-36058471165c with Priority: HIGHEST for action port [ 600.200107] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a03288e-9e43-4c2f-bfdc-36058471165c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.200248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a03288e-9e43-4c2f-bfdc-36058471165c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.200305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a03288e-9e43-4c2f-bfdc-36058471165c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.200558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a03288e-9e43-4c2f-bfdc-36058471165c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.200643] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a03288e-9e43-4c2f-bfdc-36058471165c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.221664] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 600.221992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.410099] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 600.410409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.410833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.411074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.411266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.411494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.411494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.411614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.411659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.411763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.411830] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.560942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.561533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.561533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.561533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.561533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.561796] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.562035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.562035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.562257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.562257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.562442] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae already deleted. [ 600.562442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.704685] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a03288e-9e43-4c2f-bfdc-36058471165c [ 600.704685] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.704841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.704841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.705058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.705156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.705387] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a03288e-9e43-4c2f-bfdc-36058471165c already deleted. [ 600.705479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a03288e-9e43-4c2f-bfdc-36058471165c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.913385] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7040590d-4311-4db1-9c6a-3ae4e9029e7b None None] Enqueued Resource ID: a104a08e-8d87-4ff0-bd16-15401deaaa98 with Priority: HIGHEST for action port [ 600.913631] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a104a08e-8d87-4ff0-bd16-15401deaaa98 with Priority: HIGHEST for action port [ 600.914249] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a104a08e-8d87-4ff0-bd16-15401deaaa98 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.914381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a104a08e-8d87-4ff0-bd16-15401deaaa98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.914448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a104a08e-8d87-4ff0-bd16-15401deaaa98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.914695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a104a08e-8d87-4ff0-bd16-15401deaaa98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.914780] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a104a08e-8d87-4ff0-bd16-15401deaaa98',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.917505] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.917505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.917628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.917765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.917919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.918079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.918079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.918226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.918313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.918397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.918538] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.918627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.918685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.919015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.919015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.919143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.919143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.919242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.919320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.919400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.919487] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.973029] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f7c4c5a1-5e02-400c-9dd9-80a67602ccf1 tempest-ServersWithSpecificFlavorTestJSON-1415283028 tempest-ServersWithSpecificFlavorTestJSON-1415283028-project-member] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 600.974935] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 600.983062] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.983062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.983062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.983062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.983062] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.097486] env[69255]: INFO networking_nsxv3.common.synchronization [None req-c998ec36-e67f-4122-855f-114d2df57fdd None None] Enqueued Resource ID: 314b2980-6363-4944-8d33-4a2cb39f9885 with Priority: HIGHEST for action port [ 601.098180] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 314b2980-6363-4944-8d33-4a2cb39f9885 with Priority: HIGHEST for action port [ 601.098532] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-314b2980-6363-4944-8d33-4a2cb39f9885 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.098653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-314b2980-6363-4944-8d33-4a2cb39f9885" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.098736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-314b2980-6363-4944-8d33-4a2cb39f9885" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.099283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-314b2980-6363-4944-8d33-4a2cb39f9885" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.099407] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('314b2980-6363-4944-8d33-4a2cb39f9885',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.417161] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a104a08e-8d87-4ff0-bd16-15401deaaa98 [ 601.417552] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.417552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.417943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.417943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.418011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.418093] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a104a08e-8d87-4ff0-bd16-15401deaaa98 already deleted. [ 601.418163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a104a08e-8d87-4ff0-bd16-15401deaaa98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.421532] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2949be13-f858-4157-91a1-664036bdd8ee: rpc.has_security_group_logging(os_id): False [ 601.440716] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.441995] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.441995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.442559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.442559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.442559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.442559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.442775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.442864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.443384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.444916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.445706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.447060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.447060] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be created. [ 601.505617] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.505943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.506049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.506356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.506443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.506632] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b already deleted. [ 601.506677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.513240] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.513455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.513455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.513679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.513955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.515901] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 601.516778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.524718] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: IN_PROGRESS for 2s [ 601.529847] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f12d89fe-641d-4e3c-8dd5-44939692709f tempest-ServersWithSpecificFlavorTestJSON-1415283028 tempest-ServersWithSpecificFlavorTestJSON-1415283028-project-member] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 601.530415] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 601.531074] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.531074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.531920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.532250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.532777] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.602079] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 314b2980-6363-4944-8d33-4a2cb39f9885 [ 601.602329] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.602469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.602542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.602824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.602984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.603340] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:314b2980-6363-4944-8d33-4a2cb39f9885 already deleted. [ 601.603340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-314b2980-6363-4944-8d33-4a2cb39f9885" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.645679] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.645837] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.645895] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.646192] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.646499] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.646667] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.646784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.647008] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.651449] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.651449] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 601.651613] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.651881] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.651881] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.652017] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 601.652127] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.652511] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.677636] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.677636] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 601.677636] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.677636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.677636] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-89993702-4574-48ce-8ee6-6f3437363d6f taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.677636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.677636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.677636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.677636] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89993702-4574-48ce-8ee6-6f3437363d6f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.054989] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.054989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.056125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.056125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.056125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.056125] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b already deleted. [ 602.056125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.183019] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.183242] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.183809] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.183809] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.183809] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.183983] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 89993702-4574-48ce-8ee6-6f3437363d6f not found, creating... [ 602.184267] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.184429] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.184547] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.184783] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.184927] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.185644] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.187023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.187023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.187023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.187023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.187023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 89993702-4574-48ce-8ee6-6f3437363d6f is going to be created. [ 602.236071] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.236351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.236446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.236722] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.236957] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.237226] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.014846] env[69255]: INFO networking_nsxv3.common.synchronization [req-884fccde-5853-48df-914c-8ec65b385e54 req-1efe89ad-6f43-473c-b96a-546035227f78 tempest-ServersTestJSON-447164745 tempest-ServersTestJSON-447164745-project-member] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_members [ 603.022213] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_members [ 603.022213] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.022213] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.022213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.022213] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.527335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.528109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.528109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.528109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.528109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.528109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.528555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.528555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.528555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.528555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.528665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 already deleted. [ 603.528710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.542531] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 603.542819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.212152] env[69255]: INFO networking_nsxv3.common.synchronization [None req-fff9b57c-ce6e-41c7-a429-c26efb3b63c6 None None] Enqueued Resource ID: a456261f-685f-4d99-b138-ac3833e2920f with Priority: HIGHEST for action port [ 604.213945] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a456261f-685f-4d99-b138-ac3833e2920f with Priority: HIGHEST for action port [ 604.215178] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a456261f-685f-4d99-b138-ac3833e2920f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.217015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a456261f-685f-4d99-b138-ac3833e2920f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.217015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a456261f-685f-4d99-b138-ac3833e2920f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.217015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a456261f-685f-4d99-b138-ac3833e2920f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.217015] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a456261f-685f-4d99-b138-ac3833e2920f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.325304] env[69255]: INFO networking_nsxv3.common.synchronization [req-4012e6d6-e127-495b-8f89-6c07bbd2a1e6 req-1bc4cc8b-418a-4f8e-8275-bbdae2bb1a0a service nova] Enqueued Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_rules [ 604.325667] env[69255]: INFO networking_nsxv3.common.synchronization [req-4012e6d6-e127-495b-8f89-6c07bbd2a1e6 req-1bc4cc8b-418a-4f8e-8275-bbdae2bb1a0a service nova] Enqueued Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_members [ 604.325841] env[69255]: INFO networking_nsxv3.common.synchronization [req-4012e6d6-e127-495b-8f89-6c07bbd2a1e6 req-1bc4cc8b-418a-4f8e-8275-bbdae2bb1a0a service nova] Enqueued Resource ID: 89993702-4574-48ce-8ee6-6f3437363d6f with Priority: HIGHEST for action port [ 604.326383] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_rules [ 604.326527] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_members [ 604.326623] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89993702-4574-48ce-8ee6-6f3437363d6f with Priority: HIGHEST for action port [ 604.327222] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.327357] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.327434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.327678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.327793] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.328637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.328754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.328820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.328995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.329150] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.329233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.329317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.329663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.329800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.329907] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.331902] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-89993702-4574-48ce-8ee6-6f3437363d6f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.331902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.331902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.331902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.331902] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89993702-4574-48ce-8ee6-6f3437363d6f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.383184] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f9a269f0-93a6-447d-9a20-b977131f13ee None None] Enqueued Resource ID: e898c0b9-ff0a-4490-aa2b-1f0e608585fb with Priority: HIGHEST for action port [ 604.384201] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e898c0b9-ff0a-4490-aa2b-1f0e608585fb with Priority: HIGHEST for action port [ 604.384548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e898c0b9-ff0a-4490-aa2b-1f0e608585fb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.384705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e898c0b9-ff0a-4490-aa2b-1f0e608585fb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.384796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e898c0b9-ff0a-4490-aa2b-1f0e608585fb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.385304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e898c0b9-ff0a-4490-aa2b-1f0e608585fb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.385412] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e898c0b9-ff0a-4490-aa2b-1f0e608585fb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.717225] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.717891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-977" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.717891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-977" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.717891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-977" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.718124] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.718285] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.718401] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.718655] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.719659] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.720191] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.720365] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.720481] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.720600] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.720735] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.720811] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.721300] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.722562] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a456261f-685f-4d99-b138-ac3833e2920f [ 604.722777] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.722939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.722988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.723138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.723223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.723309] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a456261f-685f-4d99-b138-ac3833e2920f already deleted. [ 604.723390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a456261f-685f-4d99-b138-ac3833e2920f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.745258] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.745258] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 604.745473] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.745545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-977" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.745876] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-9765521d-bb9e-4f96-b6f7-dc158a126df2 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.746077] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.746201] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.746517] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.746662] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9765521d-bb9e-4f96-b6f7-dc158a126df2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.832921] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.834034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.834034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.838918] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89993702-4574-48ce-8ee6-6f3437363d6f with status ACTIVE [ 604.838918] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.838918] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.838918] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.838918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.838918] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89993702-4574-48ce-8ee6-6f3437363d6f is going to be updated. [ 604.868033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.868033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.868033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.868033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.868033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.868309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89993702-4574-48ce-8ee6-6f3437363d6f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.887073] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e898c0b9-ff0a-4490-aa2b-1f0e608585fb [ 604.887311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.887448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.887551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.887742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.888271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.888271] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e898c0b9-ff0a-4490-aa2b-1f0e608585fb already deleted. [ 604.888271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e898c0b9-ff0a-4490-aa2b-1f0e608585fb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.249927] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.250383] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.250383] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.250683] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.250890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.251049] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 9765521d-bb9e-4f96-b6f7-dc158a126df2 not found, creating... [ 605.252106] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.252106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.252106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.252398] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.252398] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.252739] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.252868] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.252983] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.254133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.254296] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.254449] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 9765521d-bb9e-4f96-b6f7-dc158a126df2 is going to be created. [ 605.275914] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.277166] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.277894] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.279132] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.279132] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.279132] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.336799] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.818284] env[69255]: INFO networking_nsxv3.common.synchronization [None req-93b58328-349c-495b-a503-293c5344f66a None None] Enqueued Resource ID: c9766f19-3b6c-4568-8eb6-277f0af7f4a1 with Priority: HIGHEST for action port [ 605.818847] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9766f19-3b6c-4568-8eb6-277f0af7f4a1 with Priority: HIGHEST for action port [ 605.819762] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9766f19-3b6c-4568-8eb6-277f0af7f4a1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.819911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9766f19-3b6c-4568-8eb6-277f0af7f4a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.820722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9766f19-3b6c-4568-8eb6-277f0af7f4a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.822312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9766f19-3b6c-4568-8eb6-277f0af7f4a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.822479] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9766f19-3b6c-4568-8eb6-277f0af7f4a1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.841097] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.841097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.841097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.843255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.843255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.843255] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae is going to be created. [ 605.870620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.871976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.872229] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.873405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.873405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.886023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae in Status: UNINITIALIZED for 2s [ 605.959392] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a67893c1-6edf-4001-9f14-8d655da4e849 None None] Enqueued Resource ID: 34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a with Priority: HIGHEST for action port [ 605.962391] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a with Priority: HIGHEST for action port [ 605.962391] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.962391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.962391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.962391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.962890] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.325090] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9766f19-3b6c-4568-8eb6-277f0af7f4a1 [ 606.325538] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.325538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.325677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.325852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.325924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.325973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9766f19-3b6c-4568-8eb6-277f0af7f4a1 already deleted. [ 606.326045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9766f19-3b6c-4568-8eb6-277f0af7f4a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.466719] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a [ 606.466719] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.467060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.467060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.467258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.467862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.467862] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a already deleted. [ 606.467862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ad0d19-6a5d-4dfa-a6df-3d53d026ac4a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.997200] env[69255]: INFO networking_nsxv3.common.synchronization [req-884fccde-5853-48df-914c-8ec65b385e54 req-00641769-1172-4f05-a380-8b664dea75fd service nova] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_rules [ 606.997371] env[69255]: INFO networking_nsxv3.common.synchronization [req-884fccde-5853-48df-914c-8ec65b385e54 req-00641769-1172-4f05-a380-8b664dea75fd service nova] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_members [ 606.997508] env[69255]: INFO networking_nsxv3.common.synchronization [req-884fccde-5853-48df-914c-8ec65b385e54 req-00641769-1172-4f05-a380-8b664dea75fd service nova] Enqueued Resource ID: 9765521d-bb9e-4f96-b6f7-dc158a126df2 with Priority: HIGHEST for action port [ 606.997734] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_rules [ 606.997856] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_members [ 606.997948] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9765521d-bb9e-4f96-b6f7-dc158a126df2 with Priority: HIGHEST for action port [ 606.999442] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.999442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.999442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.999442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.999442] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.001069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.001069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.001069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.001230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.001320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.001401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.001459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.001600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.001686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.001771] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.003840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9765521d-bb9e-4f96-b6f7-dc158a126df2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.003840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.004102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.004133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.004187] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9765521d-bb9e-4f96-b6f7-dc158a126df2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.441102] env[69255]: INFO networking_nsxv3.common.synchronization [None req-5bb25ac6-d35b-444e-9b78-906bddc4c735 None None] Enqueued Resource ID: 116797fa-83d1-4d0a-935b-6ab66c021c5f with Priority: HIGHEST for action port [ 607.444123] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 116797fa-83d1-4d0a-935b-6ab66c021c5f with Priority: HIGHEST for action port [ 607.444123] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-116797fa-83d1-4d0a-935b-6ab66c021c5f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.444123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-116797fa-83d1-4d0a-935b-6ab66c021c5f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.444123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-116797fa-83d1-4d0a-935b-6ab66c021c5f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.444123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-116797fa-83d1-4d0a-935b-6ab66c021c5f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.444123] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('116797fa-83d1-4d0a-935b-6ab66c021c5f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.509180] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.509180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.509180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.509180] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9765521d-bb9e-4f96-b6f7-dc158a126df2 with status ACTIVE [ 607.509180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.509180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.509180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.509633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.509633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.509633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.509633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.509633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.509826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.510824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.510824] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.510824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.510824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.511126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.511347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.511428] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9765521d-bb9e-4f96-b6f7-dc158a126df2 is going to be updated. [ 607.544401] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.544943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.544943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.544943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.544943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.545350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9765521d-bb9e-4f96-b6f7-dc158a126df2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.562300] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f8aa272b-3f82-476d-96fc-72a8a3d488e2 None None] Enqueued Resource ID: 6bc572d1-5e38-45a5-8830-d796f067bd71 with Priority: HIGHEST for action port [ 607.563438] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bc572d1-5e38-45a5-8830-d796f067bd71 with Priority: HIGHEST for action port [ 607.563750] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bc572d1-5e38-45a5-8830-d796f067bd71 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.563893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bc572d1-5e38-45a5-8830-d796f067bd71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.564045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bc572d1-5e38-45a5-8830-d796f067bd71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.564274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bc572d1-5e38-45a5-8830-d796f067bd71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.564367] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bc572d1-5e38-45a5-8830-d796f067bd71',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.899580] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae in Status: SUCCESS [ 607.904139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.904139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.904139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.904139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.904327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.904327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.904451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.904528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.904608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.904699] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.949541] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 116797fa-83d1-4d0a-935b-6ab66c021c5f [ 607.949775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.949911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.949980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.950221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.950341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.950474] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:116797fa-83d1-4d0a-935b-6ab66c021c5f already deleted. [ 607.950474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-116797fa-83d1-4d0a-935b-6ab66c021c5f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.017609] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.067293] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bc572d1-5e38-45a5-8830-d796f067bd71 [ 608.067531] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.067705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.067760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.068288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.068403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.068499] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bc572d1-5e38-45a5-8830-d796f067bd71 already deleted. [ 608.068586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bc572d1-5e38-45a5-8830-d796f067bd71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.407847] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.408080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.408130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.408338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.408509] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.408607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.408673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.408814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.408898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.408983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.409272] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.409272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.409272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.409411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.409539] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.409620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.409675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.410107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.410107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.410107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.410107] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.522746] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.522746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.522746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.522746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.522746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.522746] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 is going to be created. [ 608.553366] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.554279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.554358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.554668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.554921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.568224] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 in Status: UNINITIALIZED for 2s [ 608.916410] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7af381e4-0258-42b9-9d7f-b2370cc5a4ae: rpc.has_security_group_logging(os_id): False [ 608.937505] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.937505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.937505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.937505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.937505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.938757] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.938757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.938757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.938757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.938965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.939483] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.939613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.939613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.939746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.939986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.940207] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.940207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.940367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.940507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.940507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.940835] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae is going to be created. [ 609.011774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.011774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.011774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.011774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.012214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.026484] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae in Status: IN_PROGRESS for 2s [ 609.099716] env[69255]: INFO networking_nsxv3.common.synchronization [None req-26f23f73-ecb1-4199-8d28-47c9732a2b80 None None] Enqueued Resource ID: 2fa8f9c9-7fc1-47e9-8708-30847ad6c052 with Priority: HIGHEST for action port [ 609.099716] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa8f9c9-7fc1-47e9-8708-30847ad6c052 with Priority: HIGHEST for action port [ 609.103104] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa8f9c9-7fc1-47e9-8708-30847ad6c052 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.103359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa8f9c9-7fc1-47e9-8708-30847ad6c052" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.103446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa8f9c9-7fc1-47e9-8708-30847ad6c052" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.103738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa8f9c9-7fc1-47e9-8708-30847ad6c052" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.103884] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa8f9c9-7fc1-47e9-8708-30847ad6c052',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.391822] env[69255]: INFO networking_nsxv3.common.synchronization [None req-2c75b3ea-3a15-4d6e-a7e6-a2263d110d79 None None] Enqueued Resource ID: b78775ef-2120-4b98-912d-16ef6f63ac46 with Priority: HIGHEST for action port [ 609.391822] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b78775ef-2120-4b98-912d-16ef6f63ac46 with Priority: HIGHEST for action port [ 609.391822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b78775ef-2120-4b98-912d-16ef6f63ac46 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.391822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b78775ef-2120-4b98-912d-16ef6f63ac46" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.391822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b78775ef-2120-4b98-912d-16ef6f63ac46" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.392211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b78775ef-2120-4b98-912d-16ef6f63ac46" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.392211] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b78775ef-2120-4b98-912d-16ef6f63ac46',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.606483] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fa8f9c9-7fc1-47e9-8708-30847ad6c052 [ 609.607019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.607364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.607364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.607592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.607697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.607799] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fa8f9c9-7fc1-47e9-8708-30847ad6c052 already deleted. [ 609.607884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa8f9c9-7fc1-47e9-8708-30847ad6c052" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.896032] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b78775ef-2120-4b98-912d-16ef6f63ac46 [ 609.896323] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.896502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.896619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.896858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.896957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.897081] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b78775ef-2120-4b98-912d-16ef6f63ac46 already deleted. [ 609.897168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b78775ef-2120-4b98-912d-16ef6f63ac46" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.450018] env[69255]: INFO networking_nsxv3.common.synchronization [req-b619dff9-e0e8-4bc8-8ab1-ce33389d55cd req-ea7c9fa7-2888-4e64-bf2f-a6ebbd395abf tempest-VolumesAssistedSnapshotsTest-1320610663 tempest-VolumesAssistedSnapshotsTest-1320610663-project-member] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_members [ 610.450847] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_members [ 610.451227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.451387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.451387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.451669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.451874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.451874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.452028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.452373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.452373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.452373] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.580695] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 in Status: SUCCESS [ 610.580783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.580930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.581171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.581932] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.581932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.581932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.581932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.581932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.581932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.582280] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.877354] env[69255]: INFO networking_nsxv3.common.synchronization [None req-64879cb6-b5b9-4b5b-8c85-fd0df96753c0 None None] Enqueued Resource ID: 9376f895-8905-4696-abad-dc0c3f8a7f38 with Priority: HIGHEST for action port [ 610.878248] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9376f895-8905-4696-abad-dc0c3f8a7f38 with Priority: HIGHEST for action port [ 610.878568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9376f895-8905-4696-abad-dc0c3f8a7f38 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.878757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9376f895-8905-4696-abad-dc0c3f8a7f38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.878833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9376f895-8905-4696-abad-dc0c3f8a7f38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.879147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9376f895-8905-4696-abad-dc0c3f8a7f38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.879266] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9376f895-8905-4696-abad-dc0c3f8a7f38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.919143] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-464 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.919143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-464" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.919143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-464" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.919488] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-464" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.919870] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.919957] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.920561] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.920873] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.921077] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.921346] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 610.921480] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.921627] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.921737] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.921859] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 610.921969] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.922131] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.946878] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.947114] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 610.947306] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.947445] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-464" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.947911] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-bdd98205-2925-4811-b952-66194cf54709 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.948315] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.948315] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.948592] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.948741] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdd98205-2925-4811-b952-66194cf54709',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.954915] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.954915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.954915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.955155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.955155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.955271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.955393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.955452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.955600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.955676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.958039] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 already deleted. [ 610.958039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.041673] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae in Status: SUCCESS [ 611.041906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.087891] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.382895] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9376f895-8905-4696-abad-dc0c3f8a7f38 [ 611.382895] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.382895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.382895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.382895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.382895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.382895] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9376f895-8905-4696-abad-dc0c3f8a7f38 already deleted. [ 611.382895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9376f895-8905-4696-abad-dc0c3f8a7f38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.451679] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.451679] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.451843] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.452142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.452305] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.452470] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port bdd98205-2925-4811-b952-66194cf54709 not found, creating... [ 611.452762] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.452926] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.453058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.453285] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.453422] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.453754] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.453942] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.454243] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.454521] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.454717] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.454902] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: bdd98205-2925-4811-b952-66194cf54709 is going to be created. [ 611.478984] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.479249] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.479422] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.479826] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.480289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.480396] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.590751] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a499bc4-6e98-47ff-b1a3-d708876db0c4: rpc.has_security_group_logging(os_id): False [ 611.616037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.616037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.616037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.616037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.616037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.616037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.616037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.616718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.616922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.617037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.618821] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 is going to be created. [ 611.696568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.696568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.696568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.696568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.696995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.709690] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 in Status: IN_PROGRESS for 2s [ 612.642303] env[69255]: INFO networking_nsxv3.common.synchronization [None req-2a3e3b78-a2f3-477c-b8e6-393a1a7d64e5 None None] Enqueued Resource ID: 14017a4a-8c83-4f40-a1ef-6ba9dc788a10 with Priority: HIGHEST for action port [ 612.642569] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14017a4a-8c83-4f40-a1ef-6ba9dc788a10 with Priority: HIGHEST for action port [ 612.644221] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-14017a4a-8c83-4f40-a1ef-6ba9dc788a10 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.644221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14017a4a-8c83-4f40-a1ef-6ba9dc788a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.644221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14017a4a-8c83-4f40-a1ef-6ba9dc788a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.644221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14017a4a-8c83-4f40-a1ef-6ba9dc788a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.644221] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14017a4a-8c83-4f40-a1ef-6ba9dc788a10',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.720064] env[69255]: INFO networking_nsxv3.common.synchronization [req-b619dff9-e0e8-4bc8-8ab1-ce33389d55cd req-b7792db6-cc74-4d1e-865f-615eb0c20371 service nova] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_rules [ 612.720064] env[69255]: INFO networking_nsxv3.common.synchronization [req-b619dff9-e0e8-4bc8-8ab1-ce33389d55cd req-b7792db6-cc74-4d1e-865f-615eb0c20371 service nova] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_members [ 612.720064] env[69255]: INFO networking_nsxv3.common.synchronization [req-b619dff9-e0e8-4bc8-8ab1-ce33389d55cd req-b7792db6-cc74-4d1e-865f-615eb0c20371 service nova] Enqueued Resource ID: bdd98205-2925-4811-b952-66194cf54709 with Priority: HIGHEST for action port [ 612.720064] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_rules [ 612.720064] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_members [ 612.720064] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd98205-2925-4811-b952-66194cf54709 with Priority: HIGHEST for action port [ 612.721105] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.721626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.721928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.722520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.722773] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.724170] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.725206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.725443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.729028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.729028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.729028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdd98205-2925-4811-b952-66194cf54709 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.729028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdd98205-2925-4811-b952-66194cf54709',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.781589] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f1de5698-e27e-45be-8abb-00fa30e15647 tempest-ServersTestBootFromVolume-1949505041 tempest-ServersTestBootFromVolume-1949505041-project-member] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_rules [ 612.782093] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_rules [ 612.782589] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.782745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.782816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.787615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.787615] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.999020] env[69255]: INFO networking_nsxv3.common.synchronization [req-ed73d5a1-ae00-4860-b2c1-6a9e49248c7b req-b337a764-9e3d-4ba3-88b3-fcf900962354 tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 612.999020] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 612.999685] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.001879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.001879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.001879] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.128585] env[69255]: INFO networking_nsxv3.common.synchronization [None req-b4c39afe-8ef6-42f0-b909-e83e8e00692b tempest-ServersTestBootFromVolume-1949505041 tempest-ServersTestBootFromVolume-1949505041-project-member] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_rules [ 613.129411] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_rules [ 613.129835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.129835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.147427] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14017a4a-8c83-4f40-a1ef-6ba9dc788a10 [ 613.147651] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.148030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.148166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.148427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.148537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.148608] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14017a4a-8c83-4f40-a1ef-6ba9dc788a10 already deleted. [ 613.148692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14017a4a-8c83-4f40-a1ef-6ba9dc788a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.211542] env[69255]: INFO networking_nsxv3.common.synchronization [None req-afc9b101-7597-4824-838c-4efecfffca8d None None] Enqueued Resource ID: 151883d9-5c8d-4914-abfa-747ad6eb39a7 with Priority: HIGHEST for action port [ 613.211864] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151883d9-5c8d-4914-abfa-747ad6eb39a7 with Priority: HIGHEST for action port [ 613.212579] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-151883d9-5c8d-4914-abfa-747ad6eb39a7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.212747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-151883d9-5c8d-4914-abfa-747ad6eb39a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.212840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-151883d9-5c8d-4914-abfa-747ad6eb39a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.213148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-151883d9-5c8d-4914-abfa-747ad6eb39a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.213292] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151883d9-5c8d-4914-abfa-747ad6eb39a7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.235578] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.235578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.235578] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.239946] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdd98205-2925-4811-b952-66194cf54709 with status ACTIVE [ 613.239946] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.239946] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.239946] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.239946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.239946] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdd98205-2925-4811-b952-66194cf54709 is going to be updated. [ 613.262541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.262541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.262541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.262950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.263032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.263256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdd98205-2925-4811-b952-66194cf54709" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.309160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.309160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.309160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.309160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.309160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.309422] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e already deleted. [ 613.309422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.309422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.309648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.309681] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.432384] env[69255]: INFO networking_nsxv3.common.synchronization [req-a942e509-be6b-4d84-ba7c-e57e67732f6d req-e57fc3b5-2ffc-4960-b099-628f70b8d6f5 tempest-DeleteServersAdminTestJSON-772420648 tempest-DeleteServersAdminTestJSON-772420648-project-admin] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 613.432697] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 613.433437] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.433437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.433615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.433685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.433831] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.433932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.434400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.434707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.434829] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.506120] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.507031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.507031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.507031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.507031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.507031] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.507031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.507496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.507496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.507496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.507618] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 already deleted. [ 613.507660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.719620] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 151883d9-5c8d-4914-abfa-747ad6eb39a7 [ 613.721299] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.721299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.721299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.721299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.721299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.721299] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:151883d9-5c8d-4914-abfa-747ad6eb39a7 already deleted. [ 613.721299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-151883d9-5c8d-4914-abfa-747ad6eb39a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.731146] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 in Status: SUCCESS [ 613.731146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.741989] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.833254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.833402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.833471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.833771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.833837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.833884] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e already deleted. [ 613.833963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.938152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.938304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.938408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.938577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.938680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.938869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.938967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.939039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.939268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.939393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.939497] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be updated. [ 613.982340] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.982476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.982541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.982903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.982994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.992599] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: IN_PROGRESS for 2s [ 614.244901] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.245064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.245143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.245462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.245462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.245595] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 is going to be created. [ 614.274268] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.274268] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.274268] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.274480] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.274630] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.275309] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.275431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.275662] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.276507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.276764] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.276873] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.276952] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.277073] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.277188] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.277294] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.277429] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.281573] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.281573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.281734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.281771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.281916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.296513] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 in Status: UNINITIALIZED for 2s [ 614.302047] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.302158] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 614.302265] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.302456] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.302787] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.303684] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.303684] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.303684] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.303684] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.808384] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.808384] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.808384] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.808876] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.808876] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.809207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 not found, creating... [ 614.809291] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.809850] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.809850] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.809850] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.812083] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.812083] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.812083] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.812083] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.812340] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.812435] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.813394] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 is going to be created. [ 614.841719] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.841931] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.842075] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.842345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.843251] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.843251] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.051095] env[69255]: INFO networking_nsxv3.common.synchronization [req-ecf57f92-800e-450e-8742-332af7da0b2e req-8eab4175-c7f0-4cf9-9a52-3a59ddc1e0ff tempest-ServersWithSpecificFlavorTestJSON-1415283028 tempest-ServersWithSpecificFlavorTestJSON-1415283028-project-member] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 615.051734] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 615.052063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.052194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.052269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.052844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.053515] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.056660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.056660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.056660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.056660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.056660] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.255807] env[69255]: INFO networking_nsxv3.common.synchronization [None req-410107f0-b9da-42e2-8d39-6cd1ad27b7d7 None None] Enqueued Resource ID: 380bc42c-4866-4aef-ae1a-32248ea48e54 with Priority: HIGHEST for action port [ 615.255807] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380bc42c-4866-4aef-ae1a-32248ea48e54 with Priority: HIGHEST for action port [ 615.255807] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-380bc42c-4866-4aef-ae1a-32248ea48e54 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.255807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-380bc42c-4866-4aef-ae1a-32248ea48e54" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.255807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-380bc42c-4866-4aef-ae1a-32248ea48e54" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.255807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-380bc42c-4866-4aef-ae1a-32248ea48e54" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.255807] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380bc42c-4866-4aef-ae1a-32248ea48e54',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.560037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.560037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.560037] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b already deleted. [ 615.560037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.761412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 380bc42c-4866-4aef-ae1a-32248ea48e54 [ 615.761645] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.761783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.761845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.762173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.762173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.762317] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:380bc42c-4866-4aef-ae1a-32248ea48e54 already deleted. [ 615.762369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-380bc42c-4866-4aef-ae1a-32248ea48e54" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.005083] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 616.005409] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a deletion is rescheduled due to dependency. [ 616.005409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.029975] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.030197] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.030352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.030699] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.031024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.031174] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.031355] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.031587] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.031721] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.032311] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.032311] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.032311] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.032311] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.032483] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.032483] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.032773] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.055159] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.055350] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 616.055510] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.055709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.056097] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-fc890b44-8f16-4f85-a49a-2347a5e0b52f taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.056288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.056431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.056764] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.056921] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc890b44-8f16-4f85-a49a-2347a5e0b52f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.094831] env[69255]: INFO networking_nsxv3.common.synchronization [req-ed73d5a1-ae00-4860-b2c1-6a9e49248c7b req-cb477144-f5bc-4722-a97a-57eff7baf57f service nova] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_rules [ 616.094831] env[69255]: INFO networking_nsxv3.common.synchronization [req-ed73d5a1-ae00-4860-b2c1-6a9e49248c7b req-cb477144-f5bc-4722-a97a-57eff7baf57f service nova] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 616.094831] env[69255]: INFO networking_nsxv3.common.synchronization [req-ed73d5a1-ae00-4860-b2c1-6a9e49248c7b req-cb477144-f5bc-4722-a97a-57eff7baf57f service nova] Enqueued Resource ID: cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 with Priority: HIGHEST for action port [ 616.094831] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_rules [ 616.094831] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 616.094831] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 with Priority: HIGHEST for action port [ 616.096249] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.096390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.096482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.096745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.096848] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.097746] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.097875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.097928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.098116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.098257] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.098349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.098431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.098576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.098752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.098752] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.101320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.101397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.102851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.102851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.102851] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.281915] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f62680ff-2f9d-4956-8cfb-799d7a76b42d None None] Enqueued Resource ID: 0ba5d26c-db9f-4755-8ce1-2206dc3f2dad with Priority: HIGHEST for action port [ 616.282461] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba5d26c-db9f-4755-8ce1-2206dc3f2dad with Priority: HIGHEST for action port [ 616.282938] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ba5d26c-db9f-4755-8ce1-2206dc3f2dad taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.282938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ba5d26c-db9f-4755-8ce1-2206dc3f2dad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.283260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ba5d26c-db9f-4755-8ce1-2206dc3f2dad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.283545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ba5d26c-db9f-4755-8ce1-2206dc3f2dad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.283633] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ba5d26c-db9f-4755-8ce1-2206dc3f2dad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.310249] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 in Status: SUCCESS [ 616.310568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.310734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.311049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.311322] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.311455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.311523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.311740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.311839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.311931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.312039] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.563574] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.563876] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.564057] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.564516] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.569019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.569019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port fc890b44-8f16-4f85-a49a-2347a5e0b52f not found, creating... [ 616.569019] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.569019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.569019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.569019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.569019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.569518] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.569518] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.569702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.569890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.570044] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.570194] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: fc890b44-8f16-4f85-a49a-2347a5e0b52f is going to be created. [ 616.594835] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.594835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.594835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.595175] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.595626] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.595626] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.606170] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.606170] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.606170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.610351] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 with status ACTIVE [ 616.610351] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.610351] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.610351] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.610351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.612465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.614039] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1 is going to be updated. [ 616.638038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.639184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.639719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.639987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.640387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.640474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb1c57f4-2b9a-4714-89ed-7b658ce5d9b1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.790050] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ba5d26c-db9f-4755-8ce1-2206dc3f2dad [ 616.790179] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.790348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.790455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.790787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.790942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.791119] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ba5d26c-db9f-4755-8ce1-2206dc3f2dad already deleted. [ 616.791240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ba5d26c-db9f-4755-8ce1-2206dc3f2dad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.815748] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.107068] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.319142] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6: rpc.has_security_group_logging(os_id): False [ 617.340858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.340858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.341141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.342042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.342042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.342042] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.342042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.342480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.342480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.343058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.343220] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 is going to be created. [ 617.445613] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.445842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.448099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.448099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.462550] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 in Status: IN_PROGRESS for 2s [ 617.613043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.613043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.613043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.613043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.613043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.613043] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be created. [ 617.640677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.643024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.643024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.643024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.643024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.672526] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: UNINITIALIZED for 2s [ 617.893024] env[69255]: INFO networking_nsxv3.common.synchronization [req-ecf57f92-800e-450e-8742-332af7da0b2e req-5e55b4d3-a980-45be-8e9f-29c727a38e25 service nova] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 617.893024] env[69255]: INFO networking_nsxv3.common.synchronization [req-ecf57f92-800e-450e-8742-332af7da0b2e req-5e55b4d3-a980-45be-8e9f-29c727a38e25 service nova] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 617.893024] env[69255]: INFO networking_nsxv3.common.synchronization [req-ecf57f92-800e-450e-8742-332af7da0b2e req-5e55b4d3-a980-45be-8e9f-29c727a38e25 service nova] Enqueued Resource ID: fc890b44-8f16-4f85-a49a-2347a5e0b52f with Priority: HIGHEST for action port [ 617.893405] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 617.893596] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 617.893727] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc890b44-8f16-4f85-a49a-2347a5e0b52f with Priority: HIGHEST for action port [ 617.896254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.896254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.896254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.896629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.896629] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.898328] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.898509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.898697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.899015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.899015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.899015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.899646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.899646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.899646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.899646] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.903028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc890b44-8f16-4f85-a49a-2347a5e0b52f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.903373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.903373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.903486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.903486] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc890b44-8f16-4f85-a49a-2347a5e0b52f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.974821] env[69255]: INFO networking_nsxv3.common.synchronization [req-6557a484-6d8b-4046-85a9-56c777a3bf19 req-19549aa7-ecf7-4b43-8850-ceff46f6034f tempest-FloatingIPsAssociationNegativeTestJSON-2022029825 tempest-FloatingIPsAssociationNegativeTestJSON-2022029825-project-member] Enqueued Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_members [ 617.975578] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_members [ 617.978107] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.978107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.982171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.982171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.982171] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.982171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.982171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.982450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.982450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.982450] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.405741] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.407452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.407617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.410231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc890b44-8f16-4f85-a49a-2347a5e0b52f with status ACTIVE [ 618.410871] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.411378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.411469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.412634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.413112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.414515] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.414742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.414877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.416936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.416936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.416936] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.416936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.416936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.416936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.417344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.417344] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc890b44-8f16-4f85-a49a-2347a5e0b52f is going to be updated. [ 618.458238] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.458485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.458581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.458812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.458996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.459188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc890b44-8f16-4f85-a49a-2347a5e0b52f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.485676] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.485904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.485904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.486149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.486390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.486593] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.487012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.487012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.487012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.487182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.487182] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b860cf4f-f007-40a7-9732-dcaeb48217fc already deleted. [ 618.487253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.910669] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.980170] env[69255]: INFO networking_nsxv3.common.synchronization [None req-3d2bb20f-a742-415a-9cd7-47c0bac3dd6f None None] Enqueued Resource ID: 449d5645-1eff-41cf-b20c-c8047b371ed6 with Priority: HIGHEST for action port [ 618.980213] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449d5645-1eff-41cf-b20c-c8047b371ed6 with Priority: HIGHEST for action port [ 618.981329] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-449d5645-1eff-41cf-b20c-c8047b371ed6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.981672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-449d5645-1eff-41cf-b20c-c8047b371ed6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.981672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-449d5645-1eff-41cf-b20c-c8047b371ed6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.981849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-449d5645-1eff-41cf-b20c-c8047b371ed6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.981981] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('449d5645-1eff-41cf-b20c-c8047b371ed6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.400032] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.400032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-708" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.400032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-708" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.400032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-708" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.400537] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.400871] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.401145] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.405047] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.405047] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.405047] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.405047] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.405047] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.405047] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.405047] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.405047] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.405047] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.416229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.416676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.416676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.416676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.416800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.416832] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be created. [ 619.453026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.453026] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 619.453026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.453026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-708" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.453026] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-402a0c9c-b5fa-49ae-a61d-9091d4095743 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.453026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.453026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.453026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.453026] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('402a0c9c-b5fa-49ae-a61d-9091d4095743',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.457134] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.457134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.457134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.457134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.457134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.476936] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: UNINITIALIZED for 2s [ 619.479329] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 in Status: SUCCESS [ 619.479329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.485999] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 449d5645-1eff-41cf-b20c-c8047b371ed6 [ 619.486482] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.487431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.487431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.487431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.487431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.487431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:449d5645-1eff-41cf-b20c-c8047b371ed6 already deleted. [ 619.487431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-449d5645-1eff-41cf-b20c-c8047b371ed6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.686238] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 619.686478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.688073] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.688073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.688073] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.963228] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 402a0c9c-b5fa-49ae-a61d-9091d4095743 not found, creating... [ 619.963228] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.963228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963641] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.964214] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.964401] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.964521] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.964690] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.964870] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 402a0c9c-b5fa-49ae-a61d-9091d4095743 is going to be created. [ 619.987172] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.987172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.987172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.987172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.987172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.987172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.136010] env[69255]: INFO networking_nsxv3.common.synchronization [req-18f27d3a-c96a-44cc-a918-bb28f8684c20 req-18d7cdce-36d0-4198-905a-eb38c5e38d9c tempest-ImagesOneServerTestJSON-1584038751 tempest-ImagesOneServerTestJSON-1584038751-project-member] Enqueued Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_members [ 620.136590] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_members [ 620.136891] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.139099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.139259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.139589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.139973] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.139973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.140145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.140700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.140822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.141018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.193763] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.193963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.194037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.194676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.194885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.195157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.195261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.195426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.195511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.195602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.195753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.195927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.195927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.196062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.196202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.196307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.196364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.196505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.196582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.196662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.196756] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.634348] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.634710] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-828" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.634827] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-828" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.636724] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-828" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.636724] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.636724] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.637761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.637761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.637761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.637761] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.637761] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.637761] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.638062] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.638062] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.638126] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.639439] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.643289] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.643453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.643703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.643899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.643899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.644035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.644175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.644220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.644331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.644441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.644486] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e55ab758-8173-4602-9e5f-c4388eb52159 already deleted. [ 620.644596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.663512] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.663715] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 620.663858] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.665261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-828" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.665261] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-cf0c58ff-5e55-431b-9d26-8739d91da4f2 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.665261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.665261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.665261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.665261] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf0c58ff-5e55-431b-9d26-8739d91da4f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.699310] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39f23576-868c-480d-b556-0aad9680f300: rpc.has_security_group_logging(os_id): False [ 620.722083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.725051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.725328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.725614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.725741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.726022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.726510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.726692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.727016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.727286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.727554] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.727668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.727761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.728023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.728173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.728459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.728579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.728663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.729028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.729135] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be created. [ 620.808161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.808161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.808161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.808161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.808161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.822989] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 621.167433] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.167748] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.167961] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.168352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.168534] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.168719] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port cf0c58ff-5e55-431b-9d26-8739d91da4f2 not found, creating... [ 621.169098] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.169639] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.169639] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.170731] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.170731] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.170731] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.170966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.171105] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.171343] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.171578] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.171780] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: cf0c58ff-5e55-431b-9d26-8739d91da4f2 is going to be created. [ 621.198295] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.199257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.199257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.200106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.200106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.200106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.317875] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d70ec44a-bbee-404f-bf41-5dbb57cd39fc None None] Enqueued Resource ID: 067b5d82-d536-47bb-892c-6f41e01b7d2b with Priority: HIGHEST for action port [ 621.318159] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 067b5d82-d536-47bb-892c-6f41e01b7d2b with Priority: HIGHEST for action port [ 621.318536] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-067b5d82-d536-47bb-892c-6f41e01b7d2b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.319231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-067b5d82-d536-47bb-892c-6f41e01b7d2b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.319407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-067b5d82-d536-47bb-892c-6f41e01b7d2b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.319757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-067b5d82-d536-47bb-892c-6f41e01b7d2b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.319860] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067b5d82-d536-47bb-892c-6f41e01b7d2b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.490441] env[69255]: INFO networking_nsxv3.common.synchronization [req-6557a484-6d8b-4046-85a9-56c777a3bf19 req-41e1934f-c4cd-4a27-bb55-5f36640396af service nova] Enqueued Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_rules [ 621.490925] env[69255]: INFO networking_nsxv3.common.synchronization [req-6557a484-6d8b-4046-85a9-56c777a3bf19 req-41e1934f-c4cd-4a27-bb55-5f36640396af service nova] Enqueued Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_members [ 621.491277] env[69255]: INFO networking_nsxv3.common.synchronization [req-6557a484-6d8b-4046-85a9-56c777a3bf19 req-41e1934f-c4cd-4a27-bb55-5f36640396af service nova] Enqueued Resource ID: 402a0c9c-b5fa-49ae-a61d-9091d4095743 with Priority: HIGHEST for action port [ 621.493191] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 621.493821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.497484] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_rules [ 621.497484] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_members [ 621.497484] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402a0c9c-b5fa-49ae-a61d-9091d4095743 with Priority: HIGHEST for action port [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.497484] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.497484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.497484] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.499391] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.499752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.499958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.500609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.500609] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.504384] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.504384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.504384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.504384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.504384] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.506764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.506764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.506764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.506764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.506764] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.508588] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-402a0c9c-b5fa-49ae-a61d-9091d4095743 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.508588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.508588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.508588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.508588] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('402a0c9c-b5fa-49ae-a61d-9091d4095743',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.822805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 067b5d82-d536-47bb-892c-6f41e01b7d2b [ 621.824476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.824476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.824476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.824476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.824476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.824476] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:067b5d82-d536-47bb-892c-6f41e01b7d2b already deleted. [ 621.824476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-067b5d82-d536-47bb-892c-6f41e01b7d2b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.002823] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.011433] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.012504] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.014931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 402a0c9c-b5fa-49ae-a61d-9091d4095743 with status ACTIVE [ 622.014931] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.014931] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.014931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.021019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.021019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.021019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.021019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.021019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.021019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.021019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.021019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 402a0c9c-b5fa-49ae-a61d-9091d4095743 is going to be updated. [ 622.045720] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.045720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.045720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.045720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.045720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.046095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-402a0c9c-b5fa-49ae-a61d-9091d4095743" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.506729] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f33ed09a-fe24-4b0c-9bbd-6935d7eac81b: rpc.has_security_group_logging(os_id): False [ 622.522419] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.530269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.530269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.530269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.530269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.530269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.530587] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.530587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.530722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.530834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.531034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.531231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be created. [ 622.617206] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.617455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.617455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.618223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.618586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.631740] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: IN_PROGRESS for 2s [ 622.699171] env[69255]: INFO networking_nsxv3.common.synchronization [req-18f27d3a-c96a-44cc-a918-bb28f8684c20 req-71a9f154-1259-4058-ba30-30f3b4336b82 service nova] Enqueued Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_rules [ 622.699171] env[69255]: INFO networking_nsxv3.common.synchronization [req-18f27d3a-c96a-44cc-a918-bb28f8684c20 req-71a9f154-1259-4058-ba30-30f3b4336b82 service nova] Enqueued Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_members [ 622.699171] env[69255]: INFO networking_nsxv3.common.synchronization [req-18f27d3a-c96a-44cc-a918-bb28f8684c20 req-71a9f154-1259-4058-ba30-30f3b4336b82 service nova] Enqueued Resource ID: cf0c58ff-5e55-431b-9d26-8739d91da4f2 with Priority: HIGHEST for action port [ 622.699171] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_rules [ 622.699171] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_members [ 622.699171] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0c58ff-5e55-431b-9d26-8739d91da4f2 with Priority: HIGHEST for action port [ 622.703990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.703990] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.703990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.703990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.703990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.711126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.711126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.711126] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.711126] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf0c58ff-5e55-431b-9d26-8739d91da4f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.711126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.711126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.711126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.711126] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf0c58ff-5e55-431b-9d26-8739d91da4f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.838312] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 622.838680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.029705] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.029908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.029908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.030177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.030274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.030380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b860cf4f-f007-40a7-9732-dcaeb48217fc is going to be created. [ 623.068239] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.068833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.069139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.069204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.069361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.087879] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b860cf4f-f007-40a7-9732-dcaeb48217fc in Status: UNINITIALIZED for 2s [ 623.212063] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.213245] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.213381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.217355] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf0c58ff-5e55-431b-9d26-8739d91da4f2 with status ACTIVE [ 623.217470] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.217795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.217795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.217947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.218151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.219108] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.219108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.219108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.219108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.219108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.219393] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.219393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.219474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.220743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.220743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.220743] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf0c58ff-5e55-431b-9d26-8739d91da4f2 is going to be updated. [ 623.261837] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.261837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.261837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.261837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.261837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.261837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf0c58ff-5e55-431b-9d26-8739d91da4f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.281720] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa1fdc80-bef6-4382-bc8c-c110218ddc26 req-e5d55e60-ef70-4a01-b7b6-260807be438f tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 623.283027] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 623.287975] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.288341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.288422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.288796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.289051] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.289195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.289316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.289596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.291040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.291040] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.584398] env[69255]: INFO networking_nsxv3.common.synchronization [None req-8594e0d0-55bc-4f11-ac8c-2e49c4757244 None None] Enqueued Resource ID: e21d2bcd-e072-4b0b-8140-0724d1cdd8ce with Priority: HIGHEST for action port [ 623.584809] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21d2bcd-e072-4b0b-8140-0724d1cdd8ce with Priority: HIGHEST for action port [ 623.585980] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e21d2bcd-e072-4b0b-8140-0724d1cdd8ce taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.589113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e21d2bcd-e072-4b0b-8140-0724d1cdd8ce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.589113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e21d2bcd-e072-4b0b-8140-0724d1cdd8ce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.589113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e21d2bcd-e072-4b0b-8140-0724d1cdd8ce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.589113] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e21d2bcd-e072-4b0b-8140-0724d1cdd8ce',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.714510] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.798609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.798609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.798609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.798609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.798609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.798609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.800324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.800324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.800324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.800324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.800324] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca already deleted. [ 623.800324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.090648] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e21d2bcd-e072-4b0b-8140-0724d1cdd8ce [ 624.090981] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.092671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.092671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.092671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.092671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.092671] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e21d2bcd-e072-4b0b-8140-0724d1cdd8ce already deleted. [ 624.092671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e21d2bcd-e072-4b0b-8140-0724d1cdd8ce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.188270] env[69255]: INFO networking_nsxv3.common.synchronization [None req-6a745b36-cdcf-46d8-8061-b019aa7def45 None None] Enqueued Resource ID: aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53 with Priority: HIGHEST for action port [ 624.188537] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53 with Priority: HIGHEST for action port [ 624.189101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.189315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.189315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.189544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.189628] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.219547] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.219547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.219547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.219547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.219547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.219547] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e55ab758-8173-4602-9e5f-c4388eb52159 is going to be created. [ 624.248327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.248327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.248327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.248591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.248591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.261993] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e55ab758-8173-4602-9e5f-c4388eb52159 in Status: UNINITIALIZED for 2s [ 624.645023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 624.645308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.693072] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53 [ 624.693610] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.694149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.694149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.694149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.694552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.694552] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53 already deleted. [ 624.694552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aab38c3c-a1ff-4ba2-81ff-6e5e56b25c53" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.875548] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.877017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.877017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.877017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.877017] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.877017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.877017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.877409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.878027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.878027] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.878573] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.878573] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.878573] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.878573] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.878573] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.880442] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.892159] env[69255]: INFO networking_nsxv3.common.synchronization [req-4cf17e7e-f19a-470c-a2b8-d98b5c718910 req-125e8e40-4cb3-414b-9e5f-da03c52f74cd tempest-ServerExternalEventsTest-1427679875 tempest-ServerExternalEventsTest-1427679875-project-member] Enqueued Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_members [ 624.892709] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGHEST for action security_group_members [ 624.893460] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.893460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.893460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.893622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.893728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.893831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.893885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.894600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.894600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.894600] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.910505] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.910505] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 624.910673] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.911244] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.911244] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-b30d41cc-64f8-4938-9f5a-32a3e8c18669 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.911404] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.911446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.911800] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.911945] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30d41cc-64f8-4938-9f5a-32a3e8c18669',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.099795] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b860cf4f-f007-40a7-9732-dcaeb48217fc in Status: SUCCESS [ 625.100049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.103647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.103910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.105106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.105106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.105106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.105106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.105106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.105106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.105106] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.398907] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.398907] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.398907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.398907] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae is going to be updated. [ 625.415509] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.415982] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.416957] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.417261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.418501] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.419639] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port b30d41cc-64f8-4938-9f5a-32a3e8c18669 not found, creating... [ 625.420044] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.420232] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.420386] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.420713] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.420919] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.423360] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.424038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.424038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.424038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.424180] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.424302] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: b30d41cc-64f8-4938-9f5a-32a3e8c18669 is going to be created. [ 625.440319] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.440488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.440559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.440819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.440984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.453095] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae in Status: IN_PROGRESS for 2s [ 625.454252] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.454431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.454563] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.454849] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.456099] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.456192] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.608304] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.609449] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.609449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.609842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.610884] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.611231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.611231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.611354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.611498] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.611632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.611632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.612703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.612703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.612703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.612703] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.762114] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a7cc2c4d-bd0b-4bd3-a144-a51edcd4647d None None] Enqueued Resource ID: e59d09b5-af23-414b-928b-671a8ab03335 with Priority: HIGHEST for action port [ 625.763475] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e59d09b5-af23-414b-928b-671a8ab03335 with Priority: HIGHEST for action port [ 625.765156] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e59d09b5-af23-414b-928b-671a8ab03335 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.765156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e59d09b5-af23-414b-928b-671a8ab03335" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.765156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e59d09b5-af23-414b-928b-671a8ab03335" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.765156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e59d09b5-af23-414b-928b-671a8ab03335" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.765638] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59d09b5-af23-414b-928b-671a8ab03335',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.868165] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a6fa9c76-6566-4881-94c7-557389770fda tempest-VolumesAdminNegativeTest-714470093 tempest-VolumesAdminNegativeTest-714470093-project-member] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_rules [ 625.868165] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_rules [ 625.868165] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.868165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.868165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.869545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.869868] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.118497] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b860cf4f-f007-40a7-9732-dcaeb48217fc: rpc.has_security_group_logging(os_id): False [ 626.139648] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.140887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.140887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.141309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.141309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.141554] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.143286] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.143286] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.143286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.143286] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b860cf4f-f007-40a7-9732-dcaeb48217fc is going to be created. [ 626.237452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.237452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.237452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.238108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.238108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.251392] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b860cf4f-f007-40a7-9732-dcaeb48217fc in Status: IN_PROGRESS for 2s [ 626.268124] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e59d09b5-af23-414b-928b-671a8ab03335 [ 626.270534] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.270534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.270534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.270534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.272214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.272816] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e59d09b5-af23-414b-928b-671a8ab03335 already deleted. [ 626.272816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e59d09b5-af23-414b-928b-671a8ab03335" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.275642] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e55ab758-8173-4602-9e5f-c4388eb52159 in Status: SUCCESS [ 626.275848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.276437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.276437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.276437] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.276653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.276653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.277034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.277034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.277034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.277034] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.396662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.396662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.396662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.396662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.396662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.396662] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 already deleted. [ 626.396662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.509952] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9ef1cbf9-831c-4744-abb5-4f68baa795f5 tempest-VolumesAdminNegativeTest-714470093 tempest-VolumesAdminNegativeTest-714470093-project-member] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_rules [ 626.510831] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_rules [ 626.512634] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.514019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.514019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.514019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.514019] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.783981] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.784222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.784300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.784570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.784729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.784840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.785011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.785129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.785216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.785316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.785471] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.785559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.785617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.785779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.785919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.786034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.786252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.786352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.786438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.786574] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.948655] env[69255]: INFO networking_nsxv3.common.synchronization [None req-27074830-96f0-466e-b0ef-1b3c33244113 None None] Enqueued Resource ID: a05adc9b-f179-46b3-a494-fd5f7aab6cdf with Priority: HIGHEST for action port [ 626.949674] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05adc9b-f179-46b3-a494-fd5f7aab6cdf with Priority: HIGHEST for action port [ 626.950297] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a05adc9b-f179-46b3-a494-fd5f7aab6cdf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.950414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a05adc9b-f179-46b3-a494-fd5f7aab6cdf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.952020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a05adc9b-f179-46b3-a494-fd5f7aab6cdf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.952020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a05adc9b-f179-46b3-a494-fd5f7aab6cdf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.952020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a05adc9b-f179-46b3-a494-fd5f7aab6cdf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.034544] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.034747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.034747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.034849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.035088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.035088] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 already deleted. [ 627.035223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.114709] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa1fdc80-bef6-4382-bc8c-c110218ddc26 req-021f5a64-b677-468c-8307-cb25d04351e2 service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 627.114709] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa1fdc80-bef6-4382-bc8c-c110218ddc26 req-021f5a64-b677-468c-8307-cb25d04351e2 service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 627.115059] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa1fdc80-bef6-4382-bc8c-c110218ddc26 req-021f5a64-b677-468c-8307-cb25d04351e2 service nova] Enqueued Resource ID: b30d41cc-64f8-4938-9f5a-32a3e8c18669 with Priority: HIGHEST for action port [ 627.117824] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 627.117881] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 627.117986] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b30d41cc-64f8-4938-9f5a-32a3e8c18669 with Priority: HIGHEST for action port [ 627.118714] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.119045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.119045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.119183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.119287] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.120617] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.120617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.120617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.123278] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.123278] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.123278] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b30d41cc-64f8-4938-9f5a-32a3e8c18669 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.123278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.123278] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30d41cc-64f8-4938-9f5a-32a3e8c18669',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.293384] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e55ab758-8173-4602-9e5f-c4388eb52159: rpc.has_security_group_logging(os_id): False [ 627.328445] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.328699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.328811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.329151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.329313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.329713] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.330135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.330135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.330466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.330714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.331098] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.331967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.332113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.332520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.332683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.332916] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.333150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.333238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.333486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.333614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.333758] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e55ab758-8173-4602-9e5f-c4388eb52159 is going to be created. [ 627.428993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.429279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.429279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.429502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.429685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.446311] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e55ab758-8173-4602-9e5f-c4388eb52159 in Status: IN_PROGRESS for 2s [ 627.448412] env[69255]: INFO networking_nsxv3.common.synchronization [req-42d3fcaf-b72d-4c77-a920-8e8a042deb69 req-cb2cba86-37ce-4730-a864-77fef4feee61 tempest-ServerAddressesNegativeTestJSON-286036129 tempest-ServerAddressesNegativeTestJSON-286036129-project-member] Enqueued Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_members [ 627.448996] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_members [ 627.449758] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.449758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.449758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.450328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.450559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.450751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.451050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.451050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.451159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.451240] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.453926] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a05adc9b-f179-46b3-a494-fd5f7aab6cdf [ 627.454177] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.454314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.454381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.454601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.454694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.454854] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a05adc9b-f179-46b3-a494-fd5f7aab6cdf already deleted. [ 627.454945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a05adc9b-f179-46b3-a494-fd5f7aab6cdf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.471221] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae in Status: SUCCESS [ 627.471221] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae deletion is rescheduled due to dependency. [ 627.471462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.625849] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.626052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.626208] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.627112] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b30d41cc-64f8-4938-9f5a-32a3e8c18669 with status ACTIVE [ 627.627298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.627417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.627481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.628049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.628049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.628049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.628049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.628430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.628430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.628430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.628545] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.628545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.628632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.629207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.629207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.629207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b30d41cc-64f8-4938-9f5a-32a3e8c18669 is going to be updated. [ 627.659650] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.659884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.659999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.660350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.660516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.660767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b30d41cc-64f8-4938-9f5a-32a3e8c18669" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.957074] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.957074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.957278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.957316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.957415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.958097] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.958097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.958097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.958097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.958097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.958308] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b73d257-772b-49ed-a193-0adc505752e2 already deleted. [ 627.958308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.132885] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.270678] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b860cf4f-f007-40a7-9732-dcaeb48217fc in Status: SUCCESS [ 628.270988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.640837] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.640837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.640837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.640837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.640837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.640837] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be created. [ 628.672207] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.672207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.672207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.672207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.672207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.693631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: UNINITIALIZED for 2s [ 629.468908] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e55ab758-8173-4602-9e5f-c4388eb52159 in Status: SUCCESS [ 629.470188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.514837] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.515367] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-974" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.515794] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-974" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.516253] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-974" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.517934] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.517934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.517934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.517934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.517934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.517934] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.517934] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.518476] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.518476] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.518476] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.518643] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.518752] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.544466] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.544949] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.544949] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.546194] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-974" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.546194] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-d1c3d96c-6ba2-49b3-9365-7797e501470b taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.546194] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.546194] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.546510] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.546918] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c3d96c-6ba2-49b3-9365-7797e501470b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.049710] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.049991] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.050677] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.050677] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.050677] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.051023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port d1c3d96c-6ba2-49b3-9365-7797e501470b not found, creating... [ 630.051352] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.051518] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.051660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.051893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.052106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.053801] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.053801] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.053801] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.053801] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.054015] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.054015] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: d1c3d96c-6ba2-49b3-9365-7797e501470b is going to be created. [ 630.082673] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.082938] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.083111] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.083790] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.083790] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.083938] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.694021] env[69255]: INFO networking_nsxv3.common.synchronization [None req-734d245f-399d-427e-9b08-41cd45767eb5 None None] Enqueued Resource ID: 684ff68e-39b9-439d-a8fa-092faddf4832 with Priority: HIGHEST for action port [ 630.694021] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 684ff68e-39b9-439d-a8fa-092faddf4832 with Priority: HIGHEST for action port [ 630.694021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-684ff68e-39b9-439d-a8fa-092faddf4832 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.694021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-684ff68e-39b9-439d-a8fa-092faddf4832" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.694021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-684ff68e-39b9-439d-a8fa-092faddf4832" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.694021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-684ff68e-39b9-439d-a8fa-092faddf4832" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.694021] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('684ff68e-39b9-439d-a8fa-092faddf4832',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.706547] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 630.706964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.706964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.707183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.707378] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.707525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.707596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.707749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.707849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.707938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.708058] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.199431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 684ff68e-39b9-439d-a8fa-092faddf4832 [ 631.199759] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.199882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.199882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.200137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.200266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.200333] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:684ff68e-39b9-439d-a8fa-092faddf4832 already deleted. [ 631.200412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-684ff68e-39b9-439d-a8fa-092faddf4832" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.214463] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.214638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.214784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.215032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.215230] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.215340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.215407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.215563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.215653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.215746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.215893] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.216118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.216118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.216282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.216423] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.216516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.216572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.216724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.216805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.216889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.216977] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.691261] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d6f01b35-27d0-44c6-842b-f8b9880431a0 None None] Enqueued Resource ID: 5d439264-0f2b-4098-8191-2d5708477f35 with Priority: HIGHEST for action port [ 631.694668] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d439264-0f2b-4098-8191-2d5708477f35 with Priority: HIGHEST for action port [ 631.695020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d439264-0f2b-4098-8191-2d5708477f35 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.695990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d439264-0f2b-4098-8191-2d5708477f35" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.695990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d439264-0f2b-4098-8191-2d5708477f35" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.696564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d439264-0f2b-4098-8191-2d5708477f35" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.696756] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d439264-0f2b-4098-8191-2d5708477f35',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.717862] env[69255]: INFO networking_nsxv3.common.synchronization [req-36effbba-7ea8-463f-8dad-cec53ffee703 req-6f37e7d9-8d8b-470b-9846-e9e7b1aa204a tempest-ServerDiagnosticsTest-753783499 tempest-ServerDiagnosticsTest-753783499-project-member] Enqueued Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_members [ 631.719074] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_members [ 631.719329] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 631.720636] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.721182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.721182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.721500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.721689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.721799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.722022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.722627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.722837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.723139] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.749160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.749160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.749160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.749160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.750743] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.750743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.750743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.750743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.750743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.750743] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be created. [ 631.821787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.821787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.821787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.825410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.825410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.841339] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 631.912963] env[69255]: INFO networking_nsxv3.common.synchronization [req-42d3fcaf-b72d-4c77-a920-8e8a042deb69 req-17f97a7f-db0b-412c-9027-35e8adb6d5a2 service nova] Enqueued Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_rules [ 631.913114] env[69255]: INFO networking_nsxv3.common.synchronization [req-42d3fcaf-b72d-4c77-a920-8e8a042deb69 req-17f97a7f-db0b-412c-9027-35e8adb6d5a2 service nova] Enqueued Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_members [ 631.913250] env[69255]: INFO networking_nsxv3.common.synchronization [req-42d3fcaf-b72d-4c77-a920-8e8a042deb69 req-17f97a7f-db0b-412c-9027-35e8adb6d5a2 service nova] Enqueued Resource ID: d1c3d96c-6ba2-49b3-9365-7797e501470b with Priority: HIGHEST for action port [ 631.913488] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_rules [ 631.913619] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_members [ 631.913711] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c3d96c-6ba2-49b3-9365-7797e501470b with Priority: HIGHEST for action port [ 631.914307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.914435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.914489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.914776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.914859] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.917742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.917886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.917954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.920519] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.920519] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.920519] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c3d96c-6ba2-49b3-9365-7797e501470b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.920519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.923304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.923504] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c3d96c-6ba2-49b3-9365-7797e501470b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.199306] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d439264-0f2b-4098-8191-2d5708477f35 [ 632.200678] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.200957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.201056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.201285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.203869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.203869] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d439264-0f2b-4098-8191-2d5708477f35 already deleted. [ 632.203869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d439264-0f2b-4098-8191-2d5708477f35" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.227216] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.227531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.227689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.228081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.228294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.228650] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.230151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.230212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.232954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.232954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.232954] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 already deleted. [ 632.232954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.427443] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.429879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.430010] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.433386] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1c3d96c-6ba2-49b3-9365-7797e501470b with status ACTIVE [ 632.433386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.433386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.433386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.433386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.433386] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1c3d96c-6ba2-49b3-9365-7797e501470b is going to be updated. [ 632.459402] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.459402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.459402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.459402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.459402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.459402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c3d96c-6ba2-49b3-9365-7797e501470b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.760321] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.760840] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.760840] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.760968] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.765024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.765024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.765024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.765024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.765024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.765024] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.765024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.765024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.765024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.765024] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.765024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.765024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.797023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.797023] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 632.797023] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.797023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.797023] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-1ad0ed55-cb66-459a-9a82-faa926d75efc taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.797023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.797023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.797023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.797023] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ad0ed55-cb66-459a-9a82-faa926d75efc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.931241] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.968032] env[69255]: INFO networking_nsxv3.common.synchronization [req-b11dad5a-b032-40e0-b51b-fdcc9e789408 req-fda78610-9b9c-4394-baeb-5eadd5618ab0 tempest-ServerPasswordTestJSON-489511719 tempest-ServerPasswordTestJSON-489511719-project-member] Enqueued Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_members [ 632.972151] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_members [ 632.973120] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.973571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.973680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.974135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.974386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.974555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.974890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.975537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.976099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.976467] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.021638] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7f07296c-3439-4be8-af11-175994da8b59 tempest-ServersTestManualDisk-643603432 tempest-ServersTestManualDisk-643603432-project-member] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_rules [ 633.021701] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_rules [ 633.021996] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.022189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.022189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.022462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.022766] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.300946] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.301445] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.301445] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.301568] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.301689] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.301922] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 1ad0ed55-cb66-459a-9a82-faa926d75efc not found, creating... [ 633.302119] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.302279] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.302396] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.302627] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.302829] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.305420] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.305600] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.305788] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.306197] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.306197] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.306416] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 1ad0ed55-cb66-459a-9a82-faa926d75efc is going to be created. [ 633.331993] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.332230] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.332402] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.333052] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.333052] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.333292] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.413795] env[69255]: INFO networking_nsxv3.common.synchronization [None req-c70420f7-61db-42db-92d2-88f11e00f40e tempest-ServersTestManualDisk-643603432 tempest-ServersTestManualDisk-643603432-project-member] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_rules [ 633.415178] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_rules [ 633.415178] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.415178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.436174] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.436174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.436174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.436535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.436617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.437416] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b73d257-772b-49ed-a193-0adc505752e2 is going to be created. [ 633.465914] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7a9c58be-98a7-4c76-92a9-82e50baa752a None None] Enqueued Resource ID: 4c486325-02ae-4181-abc9-4785f0689a98 with Priority: HIGHEST for action port [ 633.466582] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c486325-02ae-4181-abc9-4785f0689a98 with Priority: HIGHEST for action port [ 633.470874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c486325-02ae-4181-abc9-4785f0689a98 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.470874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c486325-02ae-4181-abc9-4785f0689a98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.470874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c486325-02ae-4181-abc9-4785f0689a98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.471137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c486325-02ae-4181-abc9-4785f0689a98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.471137] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c486325-02ae-4181-abc9-4785f0689a98',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.482548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.482548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.483396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.485028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.486064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.489774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.489774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.489975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.490180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.490331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.490624] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.490786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.491702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.491702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.491702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.491702] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b already deleted. [ 633.491702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.513674] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b73d257-772b-49ed-a193-0adc505752e2 in Status: UNINITIALIZED for 2s [ 633.554518] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.554518] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d already deleted. [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.554518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.554518] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.858148] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 633.858148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.974722] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c486325-02ae-4181-abc9-4785f0689a98 [ 633.974722] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.974722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.974722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.974923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.974923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.975010] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c486325-02ae-4181-abc9-4785f0689a98 already deleted. [ 633.978172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c486325-02ae-4181-abc9-4785f0689a98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.085667] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.085954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.085954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.086275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.086414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.086567] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d already deleted. [ 634.086705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.105764] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-685 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.106185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-685" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.106358] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-685" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.106672] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-685" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.106959] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.108855] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.108979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.109296] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.110178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.110471] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 634.110712] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.111095] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.111095] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.111233] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 634.111413] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.111629] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.145242] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.145549] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 634.145715] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.145941] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-685" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.146337] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-324aa04c-b0a5-4e9c-9899-842c2430ffed taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.146588] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.146760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.147261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.147342] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('324aa04c-b0a5-4e9c-9899-842c2430ffed',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.650453] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.650664] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.650795] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.651128] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.651377] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.651431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 324aa04c-b0a5-4e9c-9899-842c2430ffed not found, creating... [ 634.651704] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.651860] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.651980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.652446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.652446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.652692] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.652947] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.652947] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.653751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.653751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.653942] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 324aa04c-b0a5-4e9c-9899-842c2430ffed is going to be created. [ 634.676099] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.676322] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.676445] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.676758] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.676994] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.677230] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.001745] env[69255]: INFO networking_nsxv3.common.synchronization [req-36effbba-7ea8-463f-8dad-cec53ffee703 req-d6a7a53d-4b9f-48aa-baa9-8e0d54775fa4 service nova] Enqueued Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_rules [ 635.001745] env[69255]: INFO networking_nsxv3.common.synchronization [req-36effbba-7ea8-463f-8dad-cec53ffee703 req-d6a7a53d-4b9f-48aa-baa9-8e0d54775fa4 service nova] Enqueued Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_members [ 635.002042] env[69255]: INFO networking_nsxv3.common.synchronization [req-36effbba-7ea8-463f-8dad-cec53ffee703 req-d6a7a53d-4b9f-48aa-baa9-8e0d54775fa4 service nova] Enqueued Resource ID: 1ad0ed55-cb66-459a-9a82-faa926d75efc with Priority: HIGHEST for action port [ 635.002079] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_rules [ 635.002196] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_members [ 635.002295] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ad0ed55-cb66-459a-9a82-faa926d75efc with Priority: HIGHEST for action port [ 635.003020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.003932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.004078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.004446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.004588] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.005658] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.005773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.009147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.009398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.009576] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.009683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.009745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.009905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.010010] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.010137] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.011593] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ad0ed55-cb66-459a-9a82-faa926d75efc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.011593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.011593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.011593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.011593] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ad0ed55-cb66-459a-9a82-faa926d75efc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.514272] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.516228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.516228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.516991] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ad0ed55-cb66-459a-9a82-faa926d75efc with status ACTIVE [ 635.517611] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.517789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.517919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.518219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.518421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.521456] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.521456] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.521456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.521456] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ad0ed55-cb66-459a-9a82-faa926d75efc is going to be updated. [ 635.535792] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b73d257-772b-49ed-a193-0adc505752e2 in Status: SUCCESS [ 635.536310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.536515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.536809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.537114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.537203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.537409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.537482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.537592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.538162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.538162] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.547618] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.547618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.547618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.547618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.547909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.547909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ad0ed55-cb66-459a-9a82-faa926d75efc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.701998] env[69255]: INFO networking_nsxv3.common.synchronization [req-07a365e5-33e2-4ece-bd9c-0ce2afc3b111 req-3adccef7-833d-4fce-bab6-22b5a207775b tempest-ServersAdminNegativeTestJSON-361636345 tempest-ServersAdminNegativeTestJSON-361636345-project-member] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 635.703543] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 635.704299] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.704439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.704599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.704740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.704943] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.705066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.705130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.705347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.705428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.705538] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.908153] env[69255]: INFO networking_nsxv3.common.synchronization [req-b11dad5a-b032-40e0-b51b-fdcc9e789408 req-b7e904d3-6ccb-4ee5-9e29-544939d6a6e6 service nova] Enqueued Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_rules [ 635.908354] env[69255]: INFO networking_nsxv3.common.synchronization [req-b11dad5a-b032-40e0-b51b-fdcc9e789408 req-b7e904d3-6ccb-4ee5-9e29-544939d6a6e6 service nova] Enqueued Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_members [ 635.908501] env[69255]: INFO networking_nsxv3.common.synchronization [req-b11dad5a-b032-40e0-b51b-fdcc9e789408 req-b7e904d3-6ccb-4ee5-9e29-544939d6a6e6 service nova] Enqueued Resource ID: 324aa04c-b0a5-4e9c-9899-842c2430ffed with Priority: HIGHEST for action port [ 635.908746] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_rules [ 635.908877] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_members [ 635.908975] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 324aa04c-b0a5-4e9c-9899-842c2430ffed with Priority: HIGHEST for action port [ 635.909549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.909680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.909809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.913163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.913272] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.916876] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.916876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.916876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.916876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.917139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.917139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.917224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.921251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.921251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.921251] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.921755] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-324aa04c-b0a5-4e9c-9899-842c2430ffed taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.921755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.921755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.921914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.921914] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('324aa04c-b0a5-4e9c-9899-842c2430ffed',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.025921] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.041701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.041847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.042119] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.042373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.043603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.043603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.043902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.046958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.046958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.046958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.046958] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.209896] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.419387] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.419387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.428264] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 324aa04c-b0a5-4e9c-9899-842c2430ffed with status ACTIVE [ 636.428264] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.428264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.428264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.428264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.428264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.428264] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.428264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.428264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.431993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.431993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.431993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.431993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.431993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.431993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.431993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.431993] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 324aa04c-b0a5-4e9c-9899-842c2430ffed is going to be updated. [ 636.431993] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.458275] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.459332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.459332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.459332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.459332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.459332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-324aa04c-b0a5-4e9c-9899-842c2430ffed" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.528933] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.529102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.529246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.529386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.529462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.529571] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 is going to be created. [ 636.547910] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b73d257-772b-49ed-a193-0adc505752e2: rpc.has_security_group_logging(os_id): False [ 636.560655] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.560655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.560655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.560655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.561057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.580376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.580568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.580568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.580799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.580893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.581111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.581223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.581281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.581466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.581521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.581674] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.581791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.581859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.581988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.582070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.582247] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.582337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.582396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.582535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.582759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.582821] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b73d257-772b-49ed-a193-0adc505752e2 is going to be created. [ 636.588870] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 in Status: UNINITIALIZED for 2s [ 636.682111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.682326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.682385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.682564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.682793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.696420] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b73d257-772b-49ed-a193-0adc505752e2 in Status: IN_PROGRESS for 2s [ 636.714020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.933010] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.040324] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.040839] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.041065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.041352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.041630] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.041801] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.041939] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.045290] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.045454] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.045731] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.045787] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.045983] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.046096] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.046199] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.046257] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.046372] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.066965] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.066965] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 637.067211] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.067211] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.067571] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.067811] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.067921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.068646] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.068646] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('901d1d0d-4ccd-4728-ad82-6e383ff3a7dc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.165868] env[69255]: INFO networking_nsxv3.common.synchronization [None req-e01e1c3e-35ad-42c6-bfac-99d80b577063 None None] Enqueued Resource ID: 5840e81c-3290-4a62-b6fd-213a7c2d096f with Priority: HIGHEST for action port [ 637.167022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5840e81c-3290-4a62-b6fd-213a7c2d096f with Priority: HIGHEST for action port [ 637.167022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5840e81c-3290-4a62-b6fd-213a7c2d096f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.167022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5840e81c-3290-4a62-b6fd-213a7c2d096f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.167022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5840e81c-3290-4a62-b6fd-213a7c2d096f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.167726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5840e81c-3290-4a62-b6fd-213a7c2d096f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.167827] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5840e81c-3290-4a62-b6fd-213a7c2d096f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.218282] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.218282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.218282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.218282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.218282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.218282] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be updated. [ 637.258469] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.258698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.258765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.259108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.261093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.278388] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: IN_PROGRESS for 2s [ 637.437453] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.437620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.437688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.437930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.438037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.438141] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b is going to be created. [ 637.473663] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.473879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.474018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.474360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.474591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.485625] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b in Status: UNINITIALIZED for 2s [ 637.572074] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.572335] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.572527] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.573074] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.573744] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.574102] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 901d1d0d-4ccd-4728-ad82-6e383ff3a7dc not found, creating... [ 637.574927] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.575400] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.575610] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.575946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.576259] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.576683] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.576985] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.577206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.577560] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.577900] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.578097] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 901d1d0d-4ccd-4728-ad82-6e383ff3a7dc is going to be created. [ 637.603491] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.603968] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.605185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.605494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.605805] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.606088] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.670523] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5840e81c-3290-4a62-b6fd-213a7c2d096f [ 637.670749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.670908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.670979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.671215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.671625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.671625] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5840e81c-3290-4a62-b6fd-213a7c2d096f already deleted. [ 637.672689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5840e81c-3290-4a62-b6fd-213a7c2d096f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.321295] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f53f48aa-2404-4087-be3f-8dfa46437be6 None None] Enqueued Resource ID: e79b6801-9ba9-4338-ae5a-c9a1367bc6fe with Priority: HIGHEST for action port [ 638.321295] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79b6801-9ba9-4338-ae5a-c9a1367bc6fe with Priority: HIGHEST for action port [ 638.324237] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e79b6801-9ba9-4338-ae5a-c9a1367bc6fe taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.324237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e79b6801-9ba9-4338-ae5a-c9a1367bc6fe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.324237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e79b6801-9ba9-4338-ae5a-c9a1367bc6fe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.324237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e79b6801-9ba9-4338-ae5a-c9a1367bc6fe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.324237] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e79b6801-9ba9-4338-ae5a-c9a1367bc6fe',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.444321] env[69255]: INFO networking_nsxv3.common.synchronization [req-4095eb51-53f8-4b19-856b-796e20afb8c2 req-496b6133-120f-48aa-9700-24a6ab13f99f tempest-InstanceActionsTestJSON-265028220 tempest-InstanceActionsTestJSON-265028220-project-member] Enqueued Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_members [ 638.444321] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_members [ 638.444728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.444728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.444871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.445153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.446036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.446036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.446036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.446036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.446036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.446036] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.600665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 in Status: SUCCESS [ 638.600919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.601120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.601745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.601745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.601745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.601940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.601940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.602071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.602181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.602275] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.715298] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b73d257-772b-49ed-a193-0adc505752e2 in Status: SUCCESS [ 638.715298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.827020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e79b6801-9ba9-4338-ae5a-c9a1367bc6fe [ 638.827020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.827020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.827020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.827020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.827020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.827020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e79b6801-9ba9-4338-ae5a-c9a1367bc6fe already deleted. [ 638.827020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e79b6801-9ba9-4338-ae5a-c9a1367bc6fe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.955604] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.955604] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.955604] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de already deleted. [ 638.955604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.107957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.107957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.107957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.107957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.107957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.109044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.109044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.109044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.109044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.109044] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.115624] env[69255]: INFO networking_nsxv3.common.synchronization [None req-bd37575d-a535-4644-a69e-456a06a8a085 None None] Enqueued Resource ID: 2e5fd690-031d-406c-b4d2-120cf1ca5a84 with Priority: HIGHEST for action port [ 639.116294] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e5fd690-031d-406c-b4d2-120cf1ca5a84 with Priority: HIGHEST for action port [ 639.116661] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e5fd690-031d-406c-b4d2-120cf1ca5a84 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.116785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e5fd690-031d-406c-b4d2-120cf1ca5a84" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.116856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e5fd690-031d-406c-b4d2-120cf1ca5a84" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.119939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e5fd690-031d-406c-b4d2-120cf1ca5a84" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.120153] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e5fd690-031d-406c-b4d2-120cf1ca5a84',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.236166] env[69255]: INFO networking_nsxv3.common.synchronization [req-07a365e5-33e2-4ece-bd9c-0ce2afc3b111 req-4e5788f9-ae2b-45c6-9831-6c26a9492863 service nova] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_rules [ 639.236166] env[69255]: INFO networking_nsxv3.common.synchronization [req-07a365e5-33e2-4ece-bd9c-0ce2afc3b111 req-4e5788f9-ae2b-45c6-9831-6c26a9492863 service nova] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 639.236166] env[69255]: INFO networking_nsxv3.common.synchronization [req-07a365e5-33e2-4ece-bd9c-0ce2afc3b111 req-4e5788f9-ae2b-45c6-9831-6c26a9492863 service nova] Enqueued Resource ID: 901d1d0d-4ccd-4728-ad82-6e383ff3a7dc with Priority: HIGHEST for action port [ 639.236166] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_rules [ 639.236166] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 639.236166] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901d1d0d-4ccd-4728-ad82-6e383ff3a7dc with Priority: HIGHEST for action port [ 639.238618] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.238851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.238955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.239541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.239541] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.240666] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.240802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.244734] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.244734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.244734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.245144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.245144] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('901d1d0d-4ccd-4728-ad82-6e383ff3a7dc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.290812] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 639.291052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.291199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.291707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.291905] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.292093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.292093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.292278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.292362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.292462] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.387842] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.388166] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-66" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.388166] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-66" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.388451] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-66" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.388838] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.388985] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.390679] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.390679] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.390679] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.390679] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.390679] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.390679] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.390679] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.390679] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.391459] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.391691] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.414167] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.414461] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.414702] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.415023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-66" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.415932] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-09261123-8c1a-440b-b452-3fccd2b5b069 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.416236] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.416638] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.417308] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.417547] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09261123-8c1a-440b-b452-3fccd2b5b069',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.530170] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b in Status: SUCCESS [ 639.530170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.530170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.530533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.530755] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.531075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.531075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.531318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.532458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.532458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.532458] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.610797] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 898ea5ad-b2b6-409a-b279-b3855ff08553: rpc.has_security_group_logging(os_id): False [ 639.625945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e5fd690-031d-406c-b4d2-120cf1ca5a84 [ 639.625945] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.625945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.625945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.625945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.625945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.625945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e5fd690-031d-406c-b4d2-120cf1ca5a84 already deleted. [ 639.625945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e5fd690-031d-406c-b4d2-120cf1ca5a84" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.633626] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.635925] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.635925] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.635925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.636923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.636923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.637489] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.638170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.638170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.638170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.638384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.638651] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 is going to be created. [ 639.726117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.726117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.726117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.726117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.726117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.737531] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 in Status: IN_PROGRESS for 2s [ 639.750023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.750023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 901d1d0d-4ccd-4728-ad82-6e383ff3a7dc with status ACTIVE [ 639.750023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.750023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.750023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.750023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.750694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.750694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.750694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.750694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.750694] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 901d1d0d-4ccd-4728-ad82-6e383ff3a7dc is going to be updated. [ 639.764991] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f723b99b-199c-4997-9e3b-acc7d214285c None None] Enqueued Resource ID: 5324d392-5af8-4cbd-a5cd-d994929db90c with Priority: HIGHEST for action port [ 639.766438] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324d392-5af8-4cbd-a5cd-d994929db90c with Priority: HIGHEST for action port [ 639.767203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5324d392-5af8-4cbd-a5cd-d994929db90c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.767614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5324d392-5af8-4cbd-a5cd-d994929db90c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.767781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5324d392-5af8-4cbd-a5cd-d994929db90c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.768206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5324d392-5af8-4cbd-a5cd-d994929db90c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.768410] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5324d392-5af8-4cbd-a5cd-d994929db90c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.780548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.780548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.780548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.780548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.780548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.780548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-901d1d0d-4ccd-4728-ad82-6e383ff3a7dc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.795472] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.920338] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.920565] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.920691] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.921027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.921208] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.921373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 09261123-8c1a-440b-b452-3fccd2b5b069 not found, creating... [ 639.924595] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.924595] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.924595] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.924595] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.924595] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.924891] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.928194] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.928432] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.928649] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.928800] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.928956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 09261123-8c1a-440b-b452-3fccd2b5b069 is going to be created. [ 639.957283] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.958383] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.961299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.963406] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.963406] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.963406] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.035388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.035661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.035813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.036093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.036385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.038555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.038555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.038555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.038555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.038781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.038816] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.039652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.039652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.039652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.039652] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.039835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.039835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.040162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.040162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.040162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.040305] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.272203] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5324d392-5af8-4cbd-a5cd-d994929db90c [ 640.272628] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.272628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.272882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.272922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.273035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.273135] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5324d392-5af8-4cbd-a5cd-d994929db90c already deleted. [ 640.273219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5324d392-5af8-4cbd-a5cd-d994929db90c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.298208] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.546282] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d189f5a-d78d-42ab-a62b-b890fa2ed59b: rpc.has_security_group_logging(os_id): False [ 640.570481] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.570481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.570481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.570481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.570481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.570481] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.570944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.570944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.570944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.571065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.571348] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.571477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.575024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.575024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.575024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b is going to be created. [ 640.644822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.644822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.644822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.644822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.644822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.657919] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b in Status: IN_PROGRESS for 2s [ 640.801411] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.801616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.801674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.802476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.802476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.802476] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be updated. [ 640.846210] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.846381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.846469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.846708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.846881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.862120] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: IN_PROGRESS for 2s [ 641.143429] env[69255]: INFO networking_nsxv3.common.synchronization [req-4095eb51-53f8-4b19-856b-796e20afb8c2 req-0aa330cf-fe15-42db-8bf8-3a710991b9df service nova] Enqueued Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_rules [ 641.144027] env[69255]: INFO networking_nsxv3.common.synchronization [req-4095eb51-53f8-4b19-856b-796e20afb8c2 req-0aa330cf-fe15-42db-8bf8-3a710991b9df service nova] Enqueued Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_members [ 641.144027] env[69255]: INFO networking_nsxv3.common.synchronization [req-4095eb51-53f8-4b19-856b-796e20afb8c2 req-0aa330cf-fe15-42db-8bf8-3a710991b9df service nova] Enqueued Resource ID: 09261123-8c1a-440b-b452-3fccd2b5b069 with Priority: HIGHEST for action port [ 641.148256] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_rules [ 641.148256] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_members [ 641.148256] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09261123-8c1a-440b-b452-3fccd2b5b069 with Priority: HIGHEST for action port [ 641.148256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.148256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.148256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.148256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.148256] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.148891] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.149419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.149419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.152046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.152046] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.152046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-09261123-8c1a-440b-b452-3fccd2b5b069 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.152046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.152046] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09261123-8c1a-440b-b452-3fccd2b5b069',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.657698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.657698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.657698] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.658544] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09261123-8c1a-440b-b452-3fccd2b5b069 with status ACTIVE [ 641.659528] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.659528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.659528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.659528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.659528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.659528] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.659528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.659892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.659892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.659892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.659990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.669031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.669031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.669031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.669031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.669031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09261123-8c1a-440b-b452-3fccd2b5b069 is going to be updated. [ 641.695139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.695326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.695326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.695521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.695686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.695882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09261123-8c1a-440b-b452-3fccd2b5b069" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.764441] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 in Status: SUCCESS [ 641.765266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.040704] env[69255]: INFO networking_nsxv3.common.synchronization [None req-29731335-e013-459e-a96f-0c3040ef190b None None] Enqueued Resource ID: 9fbac652-df99-4360-ae4e-9799ed4c48be with Priority: HIGHEST for action port [ 642.040999] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fbac652-df99-4360-ae4e-9799ed4c48be with Priority: HIGHEST for action port [ 642.042330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fbac652-df99-4360-ae4e-9799ed4c48be taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.042460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fbac652-df99-4360-ae4e-9799ed4c48be" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.042535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fbac652-df99-4360-ae4e-9799ed4c48be" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.042862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fbac652-df99-4360-ae4e-9799ed4c48be" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.042947] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fbac652-df99-4360-ae4e-9799ed4c48be',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.166382] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.411402] env[69255]: INFO networking_nsxv3.common.synchronization [None req-c7f95227-56a6-4fb3-85b7-676bc45eb872 None None] Enqueued Resource ID: 95ace8fb-efe8-411b-96d6-13c5fa04ad75 with Priority: HIGHEST for action port [ 642.411942] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95ace8fb-efe8-411b-96d6-13c5fa04ad75 with Priority: HIGHEST for action port [ 642.412330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-95ace8fb-efe8-411b-96d6-13c5fa04ad75 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.412424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95ace8fb-efe8-411b-96d6-13c5fa04ad75" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.412476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95ace8fb-efe8-411b-96d6-13c5fa04ad75" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.412907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95ace8fb-efe8-411b-96d6-13c5fa04ad75" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.412907] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95ace8fb-efe8-411b-96d6-13c5fa04ad75',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.547577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fbac652-df99-4360-ae4e-9799ed4c48be [ 642.547858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.548051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.548343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.548612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.549643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.549643] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fbac652-df99-4360-ae4e-9799ed4c48be already deleted. [ 642.549643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fbac652-df99-4360-ae4e-9799ed4c48be" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.668805] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.669217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.669217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.669217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.669331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.669843] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de is going to be created. [ 642.680533] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b in Status: SUCCESS [ 642.680533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.704993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.704993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.704993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.704993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.704993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.716622] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de in Status: UNINITIALIZED for 2s [ 642.879230] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 642.879489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.879686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.879946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.880184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.880337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.880443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.880703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.880816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.880933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.881094] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.918571] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95ace8fb-efe8-411b-96d6-13c5fa04ad75 [ 642.918571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.918571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.918571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.918571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.918571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.918571] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95ace8fb-efe8-411b-96d6-13c5fa04ad75 already deleted. [ 642.918571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95ace8fb-efe8-411b-96d6-13c5fa04ad75" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.154770] env[69255]: INFO networking_nsxv3.common.synchronization [None req-e0345454-284c-4dcc-b9e1-c1252789e124 None None] Enqueued Resource ID: b88fb213-1681-4360-ac33-8c754257a97c with Priority: HIGHEST for action port [ 643.156614] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88fb213-1681-4360-ac33-8c754257a97c with Priority: HIGHEST for action port [ 643.157182] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b88fb213-1681-4360-ac33-8c754257a97c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.157584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b88fb213-1681-4360-ac33-8c754257a97c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.157584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b88fb213-1681-4360-ac33-8c754257a97c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.160393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b88fb213-1681-4360-ac33-8c754257a97c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.160393] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b88fb213-1681-4360-ac33-8c754257a97c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.385606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.385757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.385822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.386148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.386357] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.386488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.386554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.386790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.386899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.387021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.387246] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.387354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.387436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.387600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.387740] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.387831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.387888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.388036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.388121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.388216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.389585] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.577023] env[69255]: INFO networking_nsxv3.common.synchronization [req-bd525559-eceb-40fa-b994-2521f667d998 req-f693b865-0403-4a2f-8a48-752add9f2a6a tempest-FloatingIPsAssociationTestJSON-1412388345 tempest-FloatingIPsAssociationTestJSON-1412388345-project-member] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 643.577023] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 643.577023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.577023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.578078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.578473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.578773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.579034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.579204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.579675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.579903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.581357] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.661774] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b88fb213-1681-4360-ac33-8c754257a97c [ 643.661774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.664575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.664575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.664575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.664575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.664575] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b88fb213-1681-4360-ac33-8c754257a97c already deleted. [ 643.664575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b88fb213-1681-4360-ac33-8c754257a97c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.893202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315: rpc.has_security_group_logging(os_id): False [ 643.916222] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.916415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.916461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.918205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.918205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.918205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.923019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.923019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.923019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.923019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.923019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.923333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.923333] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be updated. [ 644.032785] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.033016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.033016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.033126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.033319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.068768] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: IN_PROGRESS for 2s [ 644.082593] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.567428] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.567634] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.568235] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.568235] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.568510] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.568607] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.568776] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.568951] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.569115] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.569433] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.569508] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.569575] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.569678] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.570562] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.570780] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.570957] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.589116] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.595973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.596068] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 644.596811] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.597170] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-249" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.597591] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-65be8a69-7c10-4435-927c-73f401c46203 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.601855] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.601855] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.605482] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.605482] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65be8a69-7c10-4435-927c-73f401c46203',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.620435] env[69255]: INFO networking_nsxv3.common.synchronization [req-619ae1de-f019-4999-8f11-ee606e0aff95 req-c4dffa59-bbcd-49c0-9d18-7f26d87660f5 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 644.621021] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 644.622027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.622155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.622349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.622445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.622726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.622878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.622952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.623212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.623284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.623321] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.728685] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de in Status: SUCCESS [ 644.728909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.729097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.729346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.729540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.729663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.729743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.729929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.730145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.730145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.730290] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.098381] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.098381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.098381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.098381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.098381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.098381] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be updated. [ 645.109964] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.112762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.112762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.112762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.114720] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.114720] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 65be8a69-7c10-4435-927c-73f401c46203 not found, creating... [ 645.114720] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.114720] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.114720] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.115685] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.116030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.116548] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.120182] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.120182] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.120182] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.120182] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.120182] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 65be8a69-7c10-4435-927c-73f401c46203 is going to be created. [ 645.127092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.127092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.127092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.127092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.127092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.127416] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.127416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.127416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.127609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.130191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.130511] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 645.144032] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.144032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.144032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.144032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.144032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.157900] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.158228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.158363] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.158655] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.158890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.160019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.163911] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: IN_PROGRESS for 2s [ 645.190332] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.190516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.190564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.192022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.192022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.223357] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 645.233977] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.233977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.233977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.235036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.235036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.235234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.236573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.236573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.236573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.238319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.238860] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.239177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.239333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.239678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.239961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.240162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.240258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.240839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.240839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.240839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.241116] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.682351] env[69255]: INFO networking_nsxv3.common.synchronization [None req-455e2a52-50b8-40f8-bc23-872314529aaa None None] Enqueued Resource ID: e447e80a-2b1d-421d-95fe-60b27c319769 with Priority: HIGHEST for action port [ 645.682351] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e447e80a-2b1d-421d-95fe-60b27c319769 with Priority: HIGHEST for action port [ 645.683132] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e447e80a-2b1d-421d-95fe-60b27c319769 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.684393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e447e80a-2b1d-421d-95fe-60b27c319769" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.684510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e447e80a-2b1d-421d-95fe-60b27c319769" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.684991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e447e80a-2b1d-421d-95fe-60b27c319769" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.684991] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e447e80a-2b1d-421d-95fe-60b27c319769',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.747888] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf69e078-c36c-4fbc-aa38-e9cd0dd506de: rpc.has_security_group_logging(os_id): False [ 645.767242] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.769679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.769679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.769679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.770376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.770376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.770376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.770376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.770546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.770546] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de is going to be created. [ 645.836375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.836375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.836375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.836375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.836998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.847605] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de in Status: IN_PROGRESS for 2s [ 646.086274] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 646.086522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.187579] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e447e80a-2b1d-421d-95fe-60b27c319769 [ 646.187982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.187982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.188109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.188278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.188372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.188625] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e447e80a-2b1d-421d-95fe-60b27c319769 already deleted. [ 646.188745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e447e80a-2b1d-421d-95fe-60b27c319769" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.335119] env[69255]: INFO networking_nsxv3.common.synchronization [req-bd525559-eceb-40fa-b994-2521f667d998 req-128ef87d-f93f-4b1b-8aaf-986a4f964d93 service nova] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_rules [ 646.335337] env[69255]: INFO networking_nsxv3.common.synchronization [req-bd525559-eceb-40fa-b994-2521f667d998 req-128ef87d-f93f-4b1b-8aaf-986a4f964d93 service nova] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 646.335445] env[69255]: INFO networking_nsxv3.common.synchronization [req-bd525559-eceb-40fa-b994-2521f667d998 req-128ef87d-f93f-4b1b-8aaf-986a4f964d93 service nova] Enqueued Resource ID: 65be8a69-7c10-4435-927c-73f401c46203 with Priority: HIGHEST for action port [ 646.338822] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_rules [ 646.339071] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 646.339186] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65be8a69-7c10-4435-927c-73f401c46203 with Priority: HIGHEST for action port [ 646.340750] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.340750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.340750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.341261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.341261] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.341847] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.341948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.342165] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-65be8a69-7c10-4435-927c-73f401c46203 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.342275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.342335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.342532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.342627] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65be8a69-7c10-4435-927c-73f401c46203',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.345377] env[69255]: INFO networking_nsxv3.common.synchronization [None req-3f6881ef-0318-4737-b6b6-e2c0923c1c6d None None] Enqueued Resource ID: 2728c9aa-1406-4877-9680-e7498ff0c3e1 with Priority: HIGHEST for action port [ 646.345812] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c9aa-1406-4877-9680-e7498ff0c3e1 with Priority: HIGHEST for action port [ 646.346658] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2728c9aa-1406-4877-9680-e7498ff0c3e1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.346658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2728c9aa-1406-4877-9680-e7498ff0c3e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.346658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2728c9aa-1406-4877-9680-e7498ff0c3e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.346658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2728c9aa-1406-4877-9680-e7498ff0c3e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.346658] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2728c9aa-1406-4877-9680-e7498ff0c3e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.704143] env[69255]: INFO networking_nsxv3.common.synchronization [req-22a225b5-4d72-4f99-a162-4d972ca42622 req-b415a1bc-22d7-46b2-9777-2018aa7c1923 tempest-ServerDiagnosticsNegativeTest-783082886 tempest-ServerDiagnosticsNegativeTest-783082886-project-member] Enqueued Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_members [ 646.704827] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_members [ 646.709067] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.709322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.709322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.709614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.709795] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.709904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.709966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.710163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.710265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.710666] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.845218] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.845413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.846863] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65be8a69-7c10-4435-927c-73f401c46203 with status ACTIVE [ 646.847102] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.847102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.847237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.847376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.847476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.847653] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.847752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.847872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.848050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.848177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.848335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.848449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.848507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.848650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.848745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.848826] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65be8a69-7c10-4435-927c-73f401c46203 is going to be updated. [ 646.851426] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2728c9aa-1406-4877-9680-e7498ff0c3e1 [ 646.851686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.851841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.851931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.852172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.852306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.852423] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2728c9aa-1406-4877-9680-e7498ff0c3e1 already deleted. [ 646.852546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2728c9aa-1406-4877-9680-e7498ff0c3e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.877894] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.877894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.877894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.877894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.878090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.878211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65be8a69-7c10-4435-927c-73f401c46203" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.181271] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 647.181486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.181652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.181950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.182217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.182352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.182560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.182631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.182719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.182853] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.216573] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.216914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.216914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.217049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.217156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.217368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.217473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.217516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.217877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.217877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.217877] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39207596-4602-4c59-b143-d5038ebffb91 already deleted. [ 647.218043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.235013] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 647.235972] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 647.235972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.686018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.862844] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de in Status: SUCCESS [ 647.865027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.050339] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ca524be3-99e7-4781-addf-0b289f74c428 None None] Enqueued Resource ID: a869096f-cd97-4e5e-9ea3-eb3218679353 with Priority: HIGHEST for action port [ 648.051621] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a869096f-cd97-4e5e-9ea3-eb3218679353 with Priority: HIGHEST for action port [ 648.051621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a869096f-cd97-4e5e-9ea3-eb3218679353 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.051621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a869096f-cd97-4e5e-9ea3-eb3218679353" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.051887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a869096f-cd97-4e5e-9ea3-eb3218679353" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.051981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a869096f-cd97-4e5e-9ea3-eb3218679353" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.052447] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a869096f-cd97-4e5e-9ea3-eb3218679353',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.075171] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.075171] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.075171] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.075171] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.076933] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.077428] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.077822] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.078195] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.079158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.079158] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.081054] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.081054] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.081054] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.081054] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.081054] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.081054] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.109280] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.110008] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.110301] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.110552] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.111760] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-b0899c82-2b37-4c85-a48b-82166e1eaa5a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.111760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.111760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.112010] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.112539] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0899c82-2b37-4c85-a48b-82166e1eaa5a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.189956] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.556060] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a869096f-cd97-4e5e-9ea3-eb3218679353 [ 648.556543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.556543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.556719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.560041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.560041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.560041] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a869096f-cd97-4e5e-9ea3-eb3218679353 already deleted. [ 648.560041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a869096f-cd97-4e5e-9ea3-eb3218679353" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.615344] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.616154] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.616154] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.616333] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.616389] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.616536] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port b0899c82-2b37-4c85-a48b-82166e1eaa5a not found, creating... [ 648.616816] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.616990] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.617257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.617519] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.617665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.617976] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.618233] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.618299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.618483] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.618773] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.618941] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: b0899c82-2b37-4c85-a48b-82166e1eaa5a is going to be created. [ 648.644416] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.644416] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.644862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.644862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.645214] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.645318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.693039] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.695547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.695547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.695547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.695547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.695547] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be updated. [ 648.741952] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.741952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.741952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.741952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.741952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.765108] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: IN_PROGRESS for 2s [ 649.138999] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d69ad4e6-217d-4e55-9d54-56b8305fde59 None None] Enqueued Resource ID: 13b1dbd1-889d-4494-8a72-eededd85840c with Priority: HIGHEST for action port [ 649.139880] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b1dbd1-889d-4494-8a72-eededd85840c with Priority: HIGHEST for action port [ 649.140144] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-13b1dbd1-889d-4494-8a72-eededd85840c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.148930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13b1dbd1-889d-4494-8a72-eededd85840c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.148930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13b1dbd1-889d-4494-8a72-eededd85840c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.148930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13b1dbd1-889d-4494-8a72-eededd85840c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.148930] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13b1dbd1-889d-4494-8a72-eededd85840c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.650540] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13b1dbd1-889d-4494-8a72-eededd85840c [ 649.650921] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.651915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.651915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.651915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.651915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.651915] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13b1dbd1-889d-4494-8a72-eededd85840c already deleted. [ 649.651915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13b1dbd1-889d-4494-8a72-eededd85840c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.702826] env[69255]: INFO networking_nsxv3.common.synchronization [req-22a225b5-4d72-4f99-a162-4d972ca42622 req-eb2e5f22-82e5-46e3-b2b4-3731d00e013b service nova] Enqueued Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_rules [ 649.703044] env[69255]: INFO networking_nsxv3.common.synchronization [req-22a225b5-4d72-4f99-a162-4d972ca42622 req-eb2e5f22-82e5-46e3-b2b4-3731d00e013b service nova] Enqueued Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_members [ 649.703215] env[69255]: INFO networking_nsxv3.common.synchronization [req-22a225b5-4d72-4f99-a162-4d972ca42622 req-eb2e5f22-82e5-46e3-b2b4-3731d00e013b service nova] Enqueued Resource ID: b0899c82-2b37-4c85-a48b-82166e1eaa5a with Priority: HIGHEST for action port [ 649.703472] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_rules [ 649.703590] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_members [ 649.703681] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0899c82-2b37-4c85-a48b-82166e1eaa5a with Priority: HIGHEST for action port [ 649.707641] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.707641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.707641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.707641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.707641] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.707641] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.707641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.707641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.708644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.708644] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.708644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.708644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.708644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.708644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.708644] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.716931] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0899c82-2b37-4c85-a48b-82166e1eaa5a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.717074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.717582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.717582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.717582] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0899c82-2b37-4c85-a48b-82166e1eaa5a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.221447] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.221447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.221447] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.221733] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0899c82-2b37-4c85-a48b-82166e1eaa5a with status ACTIVE [ 650.222039] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.222215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.222312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.222638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.222761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.226228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.226228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.226228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.226228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.226228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.226228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.226472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.226472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.228035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.228035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.228157] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0899c82-2b37-4c85-a48b-82166e1eaa5a is going to be updated. [ 650.258812] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.260016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.260016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.260016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.260016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.260016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0899c82-2b37-4c85-a48b-82166e1eaa5a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.730408] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.779921] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 650.779921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.779921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.779921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.779921] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.779921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.779921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.780314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.780314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.780314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.780441] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.165101] env[69255]: INFO networking_nsxv3.common.synchronization [None req-0c0a690e-38e9-40ed-bdc6-1dc7c5cd71e7 None None] Enqueued Resource ID: bcda33c8-1ead-41fa-a52f-398fa28075eb with Priority: HIGHEST for action port [ 651.165707] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcda33c8-1ead-41fa-a52f-398fa28075eb with Priority: HIGHEST for action port [ 651.165829] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcda33c8-1ead-41fa-a52f-398fa28075eb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.165963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcda33c8-1ead-41fa-a52f-398fa28075eb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.166053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcda33c8-1ead-41fa-a52f-398fa28075eb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.166347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcda33c8-1ead-41fa-a52f-398fa28075eb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.166433] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcda33c8-1ead-41fa-a52f-398fa28075eb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.232610] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.232841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.232841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.233158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.233250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.233353] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39207596-4602-4c59-b143-d5038ebffb91 is going to be created. [ 651.268477] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.268648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.268648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.268836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.269088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.280660] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39207596-4602-4c59-b143-d5038ebffb91 in Status: UNINITIALIZED for 2s [ 651.286535] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.286939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.286939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.287634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.287634] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.287634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.287634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.287634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.287840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.287840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.287982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.288046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.288118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.288744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.288744] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.288744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.288744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.288744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.288744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.288961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.288961] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.596792] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b903018-18c7-45b0-bd83-6e49d62087b6 req-67a91f23-b548-406e-bbcf-ed7940bf6ed4 tempest-DeleteServersAdminTestJSON-1197380853 tempest-DeleteServersAdminTestJSON-1197380853-project-member] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 651.597489] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 651.598023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.598194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.598300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.598514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.600529] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.600529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.600529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.600529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.600529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.600529] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.669147] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcda33c8-1ead-41fa-a52f-398fa28075eb [ 651.669449] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.669644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.669747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.670052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.670183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.670329] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcda33c8-1ead-41fa-a52f-398fa28075eb already deleted. [ 651.670441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcda33c8-1ead-41fa-a52f-398fa28075eb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.799179] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2949be13-f858-4157-91a1-664036bdd8ee: rpc.has_security_group_logging(os_id): False [ 651.819854] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.820068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.820068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.820568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.820568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.820661] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.820899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.820899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.822424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.822424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.822424] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.822424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.822424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.822424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.822424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.822970] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.822970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.822970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.823108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.826381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.826381] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be updated. [ 651.905266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.905420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.905466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.906609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.906609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.927880] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: IN_PROGRESS for 2s [ 652.103360] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.103360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.103360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.103360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.103360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.103706] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.103706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.103706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.103825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.103825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.103903] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be updated. [ 652.143731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.143731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.143731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.144092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.144092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.155699] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: IN_PROGRESS for 2s [ 652.320578] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.320768] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.320898] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.321496] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.321496] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.321679] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.321794] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.322014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.322227] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.322374] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.322757] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.322757] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.322757] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.322945] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.323048] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.323182] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.352525] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.353835] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.353835] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.353835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.353835] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-380f5e47-233e-4600-9d3a-29f78175deb6 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.353835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.353835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.354253] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.354253] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380f5e47-233e-4600-9d3a-29f78175deb6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.687375] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9eafc793-3e54-440b-8377-0cee115f9aaa None None] Enqueued Resource ID: 83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b with Priority: HIGHEST for action port [ 652.688336] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b with Priority: HIGHEST for action port [ 652.689203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.689203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.689203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.689503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.689756] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.858354] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.858354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.858354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.858745] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.858944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.860250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 380f5e47-233e-4600-9d3a-29f78175deb6 not found, creating... [ 652.860250] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.860250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.860250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.860250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.860250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.860527] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.860585] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.861303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.861303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.861303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.861952] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 380f5e47-233e-4600-9d3a-29f78175deb6 is going to be created. [ 652.885186] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.885637] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.885784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.886224] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.886544] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.886867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.193289] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b [ 653.193492] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.193570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.193632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.193839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.193937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.194082] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b already deleted. [ 653.194175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83f22a96-9dbc-4a5e-aef4-a5d2ea546e6b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.293842] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39207596-4602-4c59-b143-d5038ebffb91 in Status: SUCCESS [ 653.294125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.294291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.295100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.295100] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.295100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.295100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.295100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.295100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.295375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.295375] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.797537] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.797777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.797777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.798038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.798352] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.799114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.799114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799709] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.799709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.799709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.801585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.801702] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.946342] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 653.946694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.950096] env[69255]: INFO networking_nsxv3.common.synchronization [req-9f5331a9-06df-4867-9cb9-126a0223b14f req-bd1f6cc6-bbc0-49cd-8e84-5672fa706ef3 tempest-ServerAddressesNegativeTestJSON-286036129 tempest-ServerAddressesNegativeTestJSON-286036129-project-member] Enqueued Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_members [ 653.951347] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGHEST for action security_group_members [ 653.952425] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.952633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.952755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.956022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.956022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.956022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.956022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.956022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.956022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.956022] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.175574] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 654.175939] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a deletion is rescheduled due to dependency. [ 654.175939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.305633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39207596-4602-4c59-b143-d5038ebffb91: rpc.has_security_group_logging(os_id): False [ 654.327613] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.327764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.328446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.328446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.328446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.328571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.329315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.329315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.329315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.329468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.329573] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.330017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.330150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.330461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.330461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.330921] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.330921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.330921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.331196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.331302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.331430] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39207596-4602-4c59-b143-d5038ebffb91 is going to be created. [ 654.395327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.395518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.395562] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.395787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.395971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.412344] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39207596-4602-4c59-b143-d5038ebffb91 in Status: IN_PROGRESS for 2s [ 654.459574] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.459877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.459877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.460074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.460180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.460394] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.460494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.460554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.460777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.460925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.461009] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b73d257-772b-49ed-a193-0adc505752e2 is going to be updated. [ 654.464464] env[69255]: INFO networking_nsxv3.common.synchronization [req-7c75e1c9-df7e-4670-8c5a-89a5f04643dc req-f8955051-d55a-46b5-981b-ace247c103ab tempest-ServerDiagnosticsTest-753783499 tempest-ServerDiagnosticsTest-753783499-project-member] Enqueued Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_members [ 654.466576] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGHEST for action security_group_members [ 654.466576] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.466576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.466971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.468273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.469862] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.470097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.470512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.470832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.471720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.471901] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.524638] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.525246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.525366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.525636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.525833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.538412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b73d257-772b-49ed-a193-0adc505752e2 in Status: IN_PROGRESS for 2s [ 654.821135] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b903018-18c7-45b0-bd83-6e49d62087b6 req-4be896b1-537a-443c-bee6-2659ab6e4039 service nova] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_rules [ 654.821135] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b903018-18c7-45b0-bd83-6e49d62087b6 req-4be896b1-537a-443c-bee6-2659ab6e4039 service nova] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 654.821135] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b903018-18c7-45b0-bd83-6e49d62087b6 req-4be896b1-537a-443c-bee6-2659ab6e4039 service nova] Enqueued Resource ID: 380f5e47-233e-4600-9d3a-29f78175deb6 with Priority: HIGHEST for action port [ 654.821135] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_rules [ 654.821135] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 654.821135] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380f5e47-233e-4600-9d3a-29f78175deb6 with Priority: HIGHEST for action port [ 654.821135] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.821135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.821135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.821135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.821135] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.822783] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.822979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.823086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.823561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.823561] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.823796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.823842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.824066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.824629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.824782] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.825918] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-380f5e47-233e-4600-9d3a-29f78175deb6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.826155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.828622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.828887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.829017] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380f5e47-233e-4600-9d3a-29f78175deb6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.974949] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.975313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.975313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.975488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.975582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.975780] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.975879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.975938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.976107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.976184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.976272] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 is going to be updated. [ 654.990469] env[69255]: INFO networking_nsxv3.common.synchronization [req-6eb7148e-d583-4940-a03a-28c7d08ff6f4 req-6a377aca-f35a-4713-9c46-7ca306035323 tempest-VolumesAdminNegativeTest-714470093 tempest-VolumesAdminNegativeTest-714470093-project-member] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_members [ 654.991497] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_members [ 654.991497] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.991635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.991635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.991853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.992029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.992166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.992213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.992345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.992520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.992629] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.008672] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.008839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.008839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.009023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.009488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.020737] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 in Status: IN_PROGRESS for 2s [ 655.327266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.327648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.330870] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.331882] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 380f5e47-233e-4600-9d3a-29f78175deb6 with status ACTIVE [ 655.333139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.333309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.333309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.334822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.334822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.334822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.339499] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 380f5e47-233e-4600-9d3a-29f78175deb6 is going to be updated. [ 655.368313] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.368313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.368313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.368313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.368313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.368313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-380f5e47-233e-4600-9d3a-29f78175deb6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.498086] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.498292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.498362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.498579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.498670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.498859] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.498951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.499189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.499278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.501024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.501024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 already deleted. [ 655.501024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.645101] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.645342] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.645474] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.645819] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.650188] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.650973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.650973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.650973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.650973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.651300] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.651356] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.651447] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.651555] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.651663] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.651769] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.651904] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.676508] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.676721] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.676774] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.676950] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.677297] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-66995842-e4b6-4cca-b689-3cc219f28b07 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.677474] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.677593] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.677977] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.678239] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66995842-e4b6-4cca-b689-3cc219f28b07',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.842343] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.939071] env[69255]: INFO networking_nsxv3.common.synchronization [None req-98ce3576-27e9-45f3-bdeb-c573364d69d0 None None] Enqueued Resource ID: f6f7d54d-270a-4a59-ae12-6d52098c3008 with Priority: HIGHEST for action port [ 655.939352] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f7d54d-270a-4a59-ae12-6d52098c3008 with Priority: HIGHEST for action port [ 655.940398] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f7d54d-270a-4a59-ae12-6d52098c3008 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.940600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f7d54d-270a-4a59-ae12-6d52098c3008" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.940600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f7d54d-270a-4a59-ae12-6d52098c3008" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.940952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f7d54d-270a-4a59-ae12-6d52098c3008" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.941051] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f7d54d-270a-4a59-ae12-6d52098c3008',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.180270] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.180697] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.180697] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.180982] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.181161] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.181326] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 66995842-e4b6-4cca-b689-3cc219f28b07 not found, creating... [ 656.181598] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.181756] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.181874] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.182115] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.182255] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.182534] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.184537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.184537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.184537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.184537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.184537] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 66995842-e4b6-4cca-b689-3cc219f28b07 is going to be created. [ 656.207176] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.207394] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.208026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.208026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.208026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.208232] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.344575] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.347039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.347039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.347039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.347039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.347039] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be updated. [ 656.378280] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.378280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.378280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.378280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.378280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.390455] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: IN_PROGRESS for 2s [ 656.426139] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39207596-4602-4c59-b143-d5038ebffb91 in Status: SUCCESS [ 656.427022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.446451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6f7d54d-270a-4a59-ae12-6d52098c3008 [ 656.446451] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.446451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.446451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.446451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.446451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.446451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6f7d54d-270a-4a59-ae12-6d52098c3008 already deleted. [ 656.446451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f7d54d-270a-4a59-ae12-6d52098c3008" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.549228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b73d257-772b-49ed-a193-0adc505752e2 in Status: SUCCESS [ 656.549365] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b73d257-772b-49ed-a193-0adc505752e2 deletion is rescheduled due to dependency. [ 656.549545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.769065] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9b81d1e2-5c3a-47c8-9868-b3a53cc30488 tempest-ServerActionsV293TestJSON-738517794 tempest-ServerActionsV293TestJSON-738517794-project-member] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_rules [ 656.769653] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_rules [ 656.769958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.770775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.770775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.772028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.772156] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.874036] env[69255]: INFO networking_nsxv3.common.synchronization [None req-4a266a1b-ab59-45e0-baa8-09bdd650defd tempest-ServerActionsV293TestJSON-738517794 tempest-ServerActionsV293TestJSON-738517794-project-member] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_rules [ 656.875322] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_rules [ 656.876580] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.876702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.958023] env[69255]: INFO networking_nsxv3.common.synchronization [req-72c1ca5b-1d35-4367-9932-b7eaf1f0d2cf req-0ddb2060-a230-48aa-b02f-ef09aad853b6 tempest-ServersTestBootFromVolume-1949505041 tempest-ServersTestBootFromVolume-1949505041-project-member] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_members [ 656.958023] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_members [ 656.958023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.958023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.958023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.958612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.958877] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.959133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.959290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.959597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.959834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.960135] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.031587] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 in Status: SUCCESS [ 657.032223] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 deletion is rescheduled due to dependency. [ 657.032223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.304359] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.304730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.304730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.304987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.305307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.305307] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf already deleted. [ 657.305307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.305517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.305692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.305807] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.462828] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.463292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.463292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.463537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.464487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.464704] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.464831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.464955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.465281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.465497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.465712] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e already deleted. [ 657.465844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.617500] env[69255]: INFO networking_nsxv3.common.synchronization [req-6eb7148e-d583-4940-a03a-28c7d08ff6f4 req-bf0f9c11-d0d7-48e3-8eee-51f352b30b95 service nova] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_rules [ 657.617721] env[69255]: INFO networking_nsxv3.common.synchronization [req-6eb7148e-d583-4940-a03a-28c7d08ff6f4 req-bf0f9c11-d0d7-48e3-8eee-51f352b30b95 service nova] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_members [ 657.618366] env[69255]: INFO networking_nsxv3.common.synchronization [req-6eb7148e-d583-4940-a03a-28c7d08ff6f4 req-bf0f9c11-d0d7-48e3-8eee-51f352b30b95 service nova] Enqueued Resource ID: 66995842-e4b6-4cca-b689-3cc219f28b07 with Priority: HIGHEST for action port [ 657.618690] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_rules [ 657.618852] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_members [ 657.618955] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66995842-e4b6-4cca-b689-3cc219f28b07 with Priority: HIGHEST for action port [ 657.619335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.619529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.619529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.619716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.619866] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.620730] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.620896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.620970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.621151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.621313] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.621412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.621498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.621706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.621800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.621800] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.624568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-66995842-e4b6-4cca-b689-3cc219f28b07 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.624705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.624755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.624954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.625317] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66995842-e4b6-4cca-b689-3cc219f28b07',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.827287] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.827500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.827551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.827734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.827841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.827949] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf already deleted. [ 657.828048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.129137] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66995842-e4b6-4cca-b689-3cc219f28b07 with status ACTIVE [ 658.129137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.129137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.129288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.130075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.130075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.130075] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.130075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.130075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.130075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.130075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.130384] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.130384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.130384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.130495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.130580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.130620] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66995842-e4b6-4cca-b689-3cc219f28b07 is going to be updated. [ 658.133384] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.133567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.136618] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.138185] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.138296] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-27" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.138417] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-27" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.138718] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-27" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.139024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.144254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.144254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.144254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.144254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.144254] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.144254] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.144254] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.144254] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.144254] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.144254] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.144951] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.168955] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.169222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.169222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.170402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.170402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.170402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66995842-e4b6-4cca-b689-3cc219f28b07" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.173617] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.173617] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.173617] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.173617] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-27" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.173617] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-19905edb-ee13-4f8e-b9e0-1f46bf56225c taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.174440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.174440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.174440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.174654] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19905edb-ee13-4f8e-b9e0-1f46bf56225c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.327260] env[69255]: INFO networking_nsxv3.common.synchronization [req-1fed32b2-0fe7-45b8-b1db-3d8904997515 req-89791681-eb30-4630-9514-fb4e1f146543 tempest-ServerPasswordTestJSON-489511719 tempest-ServerPasswordTestJSON-489511719-project-member] Enqueued Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_members [ 658.329170] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGHEST for action security_group_members [ 658.329170] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.329170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.329170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.329170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.329435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.329435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.329435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.329593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.329690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.329784] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.400792] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 658.401048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.401531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.401771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.401962] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.402092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.402356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.402356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.402464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.402464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.402544] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.646153] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.677853] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.678338] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.678520] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.678872] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.679086] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.679318] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 19905edb-ee13-4f8e-b9e0-1f46bf56225c not found, creating... [ 658.679665] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.679928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.680142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.680472] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.680643] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.681154] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.681470] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.681647] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.681930] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.682452] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.682795] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 19905edb-ee13-4f8e-b9e0-1f46bf56225c is going to be created. [ 658.710596] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.710824] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.710993] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.711468] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.711873] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.712295] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.833035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.833225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.833291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.833594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.833692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.833912] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.834050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.834112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.834285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.834359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.834444] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b is going to be updated. [ 658.869880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.870147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.870410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.870562] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.885621] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b in Status: IN_PROGRESS for 2s [ 658.910139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.910336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.910472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.910985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.911824] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.911824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.911824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.912128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.912128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.912128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.912370] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.912602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.912602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.913457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.913753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.913935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.914148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.914417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.914562] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.915172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.915172] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.149914] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.154658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.154658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.154658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.154658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.154658] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 is going to be created. [ 659.189039] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.189209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.189256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.189473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.189635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.212738] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: UNINITIALIZED for 2s [ 659.419852] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a: rpc.has_security_group_logging(os_id): False [ 659.440799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.440898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.440939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.441161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.441259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.441480] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.441574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.441641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.441784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.441933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.442137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.442236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.442300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.442460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.442538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.443288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.443391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.443459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.443609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.443689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.443777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be updated. [ 659.468112] env[69255]: INFO networking_nsxv3.common.synchronization [req-e22742ca-a513-421c-9c30-b66f3fa8d7b4 req-7b386e40-2a02-4812-94e3-85611c261a5c tempest-ServersTestManualDisk-643603432 tempest-ServersTestManualDisk-643603432-project-member] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_members [ 659.468575] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_members [ 659.468895] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.469108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.469108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.469377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.469540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.469639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.469712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.469851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.469938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.472623] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.534538] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.534538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.534538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.534538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.534538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.548951] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: IN_PROGRESS for 2s [ 659.974520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.974792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.974792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.975389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.975389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.975389] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.975389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.975552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.975587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.975684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.975723] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d already deleted. [ 659.975801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.121815] env[69255]: INFO networking_nsxv3.common.synchronization [req-72c1ca5b-1d35-4367-9932-b7eaf1f0d2cf req-180b72eb-80ee-4269-97bd-40fa71fb4216 service nova] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_rules [ 660.122092] env[69255]: INFO networking_nsxv3.common.synchronization [req-72c1ca5b-1d35-4367-9932-b7eaf1f0d2cf req-180b72eb-80ee-4269-97bd-40fa71fb4216 service nova] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_members [ 660.122278] env[69255]: INFO networking_nsxv3.common.synchronization [req-72c1ca5b-1d35-4367-9932-b7eaf1f0d2cf req-180b72eb-80ee-4269-97bd-40fa71fb4216 service nova] Enqueued Resource ID: 19905edb-ee13-4f8e-b9e0-1f46bf56225c with Priority: HIGHEST for action port [ 660.122570] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_rules [ 660.122745] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_members [ 660.122882] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19905edb-ee13-4f8e-b9e0-1f46bf56225c with Priority: HIGHEST for action port [ 660.123589] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.123774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.123912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.124183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.124433] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.125793] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.125990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.126268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.126349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.126603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.126750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.126836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.127056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.127183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.127296] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.128270] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-19905edb-ee13-4f8e-b9e0-1f46bf56225c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.128386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.128461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.128655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.128749] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19905edb-ee13-4f8e-b9e0-1f46bf56225c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.447203] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-726 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.447524] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-726" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.447524] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-726" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.447872] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-726" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.448160] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.448318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.448453] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.448704] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.448848] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.449084] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.449196] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.449303] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.451016] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.451016] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.451016] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.451016] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.469856] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.470043] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.470182] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.470363] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-726" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.470698] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-12628b13-16f0-48ee-b4ef-e51b3020b383 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.470867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.471023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.471390] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.471528] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12628b13-16f0-48ee-b4ef-e51b3020b383',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.632149] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.632149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.632149] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.633953] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19905edb-ee13-4f8e-b9e0-1f46bf56225c with status ACTIVE [ 660.634638] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.635154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.635154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.635154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.635373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.637258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.637258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.637258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.637258] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19905edb-ee13-4f8e-b9e0-1f46bf56225c is going to be updated. [ 660.661102] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.661299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.661349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.661543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.661681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.661897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19905edb-ee13-4f8e-b9e0-1f46bf56225c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.897816] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b in Status: SUCCESS [ 660.897816] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b deletion is rescheduled due to dependency. [ 660.897816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.977091] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.977323] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.977460] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.977744] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.977892] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.978064] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 12628b13-16f0-48ee-b4ef-e51b3020b383 not found, creating... [ 660.978328] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.978867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.979092] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.979575] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.979575] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.979922] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.981319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.981319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.981763] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.981763] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.983596] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 12628b13-16f0-48ee-b4ef-e51b3020b383 is going to be created. [ 661.004408] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.004408] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.004408] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.004629] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.005346] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.005346] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.139891] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.232109] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: SUCCESS [ 661.232807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.233161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.233451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.234673] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.234673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.234673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.234673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.234673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.234673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.234673] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.397623] env[69255]: INFO networking_nsxv3.common.synchronization [None req-32d08ba9-93e2-4709-9631-370b7731b0a5 None None] Enqueued Resource ID: 79811501-9721-430d-a014-d55247d33ee7 with Priority: HIGHEST for action port [ 661.398260] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79811501-9721-430d-a014-d55247d33ee7 with Priority: HIGHEST for action port [ 661.398695] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-79811501-9721-430d-a014-d55247d33ee7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.398881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79811501-9721-430d-a014-d55247d33ee7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.399061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79811501-9721-430d-a014-d55247d33ee7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.399553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79811501-9721-430d-a014-d55247d33ee7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.399732] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79811501-9721-430d-a014-d55247d33ee7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.563523] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 661.563793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.642751] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.642970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.643068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.643348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.643471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.643600] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e is going to be created. [ 661.671010] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.671179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.671238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.671453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.672090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.682858] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e in Status: UNINITIALIZED for 2s [ 661.737886] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.905105] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79811501-9721-430d-a014-d55247d33ee7 [ 661.905353] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.905509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.905572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.905793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.906183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.906183] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79811501-9721-430d-a014-d55247d33ee7 already deleted. [ 661.906183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79811501-9721-430d-a014-d55247d33ee7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.242427] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60b17549-d298-4dfe-a54f-a61c4d6ac8f2: rpc.has_security_group_logging(os_id): False [ 662.270080] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.270080] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.270080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.271117] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 is going to be created. [ 662.375195] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.375195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.375195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.375195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.375195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.378267] env[69255]: INFO networking_nsxv3.common.synchronization [req-e22742ca-a513-421c-9c30-b66f3fa8d7b4 req-67a9ef93-cd4d-4dbd-ad15-360384dd5c10 service nova] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_rules [ 662.378480] env[69255]: INFO networking_nsxv3.common.synchronization [req-e22742ca-a513-421c-9c30-b66f3fa8d7b4 req-67a9ef93-cd4d-4dbd-ad15-360384dd5c10 service nova] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_members [ 662.378663] env[69255]: INFO networking_nsxv3.common.synchronization [req-e22742ca-a513-421c-9c30-b66f3fa8d7b4 req-67a9ef93-cd4d-4dbd-ad15-360384dd5c10 service nova] Enqueued Resource ID: 12628b13-16f0-48ee-b4ef-e51b3020b383 with Priority: HIGHEST for action port [ 662.379257] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_rules [ 662.379418] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_members [ 662.379511] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12628b13-16f0-48ee-b4ef-e51b3020b383 with Priority: HIGHEST for action port [ 662.379767] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.379924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.379992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.380270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.380270] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.382128] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.382332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.382332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.383051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.383051] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.383051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.383051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.383555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.383708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.383894] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.387541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-12628b13-16f0-48ee-b4ef-e51b3020b383 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.387541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.387541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.388853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.388853] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12628b13-16f0-48ee-b4ef-e51b3020b383',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.406896] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: IN_PROGRESS for 2s [ 662.883154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.883660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.891663] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.897023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12628b13-16f0-48ee-b4ef-e51b3020b383 with status ACTIVE [ 662.897023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.897023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.897023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.897023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.897023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.897023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.897023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.897835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.897835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.897835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.897835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.897835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.897835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.898106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.898106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.898180] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12628b13-16f0-48ee-b4ef-e51b3020b383 is going to be updated. [ 662.927021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.927207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.927292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.927512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.927717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.927901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12628b13-16f0-48ee-b4ef-e51b3020b383" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.394094] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.699929] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e in Status: SUCCESS [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.699929] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.699929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.699929] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.899788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.899788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.899788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.899788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.899788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.899788] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d is going to be created. [ 663.933069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.935019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.935019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.935019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.935019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.946824] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06344ad6-af9c-4558-b815-01d31d55ee0d in Status: UNINITIALIZED for 2s [ 664.085372] env[69255]: INFO networking_nsxv3.common.synchronization [None req-b5435e7c-e125-4074-bd8d-65cfcfb244c9 None None] Enqueued Resource ID: 9eb49490-4576-4f65-a6ca-a6912d4cbaae with Priority: HIGHEST for action port [ 664.085372] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb49490-4576-4f65-a6ca-a6912d4cbaae with Priority: HIGHEST for action port [ 664.085372] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9eb49490-4576-4f65-a6ca-a6912d4cbaae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.085372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9eb49490-4576-4f65-a6ca-a6912d4cbaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.085372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9eb49490-4576-4f65-a6ca-a6912d4cbaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.085372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9eb49490-4576-4f65-a6ca-a6912d4cbaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.085372] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eb49490-4576-4f65-a6ca-a6912d4cbaae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.203467] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.422798] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: SUCCESS [ 664.422798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.587451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9eb49490-4576-4f65-a6ca-a6912d4cbaae [ 664.588093] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.588093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.588093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.588386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.588386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.588386] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9eb49490-4576-4f65-a6ca-a6912d4cbaae already deleted. [ 664.588498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9eb49490-4576-4f65-a6ca-a6912d4cbaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.705902] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8f85b08-83ad-443d-9e32-5acb05ba6b8e: rpc.has_security_group_logging(os_id): False [ 664.726062] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.726268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.726349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.726538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.726632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.726927] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.727043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.727090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.727247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.727354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.727424] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e is going to be created. [ 664.793733] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.793894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.793966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.794451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.812620] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e in Status: IN_PROGRESS for 2s [ 665.927976] env[69255]: INFO networking_nsxv3.common.synchronization [req-19c40a42-3211-4f15-bcd2-7dbb5566c443 req-e4e4fbb2-be33-41a6-a2ca-9d96be3c9e82 tempest-ImagesNegativeTestJSON-210346818 tempest-ImagesNegativeTestJSON-210346818-project-member] Enqueued Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_members [ 665.929270] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_members [ 665.929468] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.929624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.929716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.929979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.931454] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.931454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.931454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.931454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.931454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.931454] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.959375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06344ad6-af9c-4558-b815-01d31d55ee0d in Status: SUCCESS [ 665.959586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.960206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.960447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.960643] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.960765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.960830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.960986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.965245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.965601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.965705] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.301182] env[69255]: INFO networking_nsxv3.common.synchronization [req-a3562223-8584-4d14-acfb-5becb89db3ae req-885248b6-03b5-4ec7-a704-ee31a56455ec tempest-ServerDiagnosticsNegativeTest-783082886 tempest-ServerDiagnosticsNegativeTest-783082886-project-member] Enqueued Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_members [ 666.301182] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGHEST for action security_group_members [ 666.301182] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.301182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.302180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.302568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.302854] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.303177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.303345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.304027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.304027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.304027] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.435398] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.435398] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.435398] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 already deleted. [ 666.435398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.469733] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.702496] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.702496] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-738" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.702496] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-738" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.702496] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-738" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.702496] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.703476] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.703853] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.704212] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.704562] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.705237] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.706026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.706026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.706026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.706026] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.706026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.706026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.730184] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.730184] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.730184] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.730184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-738" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.730184] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c9694e81-602b-40aa-82d8-f5291e24c6e0 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.730184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.730184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.730833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.731243] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9694e81-602b-40aa-82d8-f5291e24c6e0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.809049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.809049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.809049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.809049] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39207596-4602-4c59-b143-d5038ebffb91 is going to be updated. [ 666.827729] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e in Status: SUCCESS [ 666.828240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.849242] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.849242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.849242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.849242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.849242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.860160] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39207596-4602-4c59-b143-d5038ebffb91 in Status: IN_PROGRESS for 2s [ 666.971948] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06344ad6-af9c-4558-b815-01d31d55ee0d: rpc.has_security_group_logging(os_id): False [ 666.996412] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.996412] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.996412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.996412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d is going to be created. [ 667.062541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.062722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.062831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.063136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.063301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.075738] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06344ad6-af9c-4558-b815-01d31d55ee0d in Status: IN_PROGRESS for 2s [ 667.235458] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.236459] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.236971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.239023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.239023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.239023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c9694e81-602b-40aa-82d8-f5291e24c6e0 not found, creating... [ 667.239023] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.239023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.239455] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.239900] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.240676] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.243440] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.243440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.243440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.243440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.243440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.243440] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c9694e81-602b-40aa-82d8-f5291e24c6e0 is going to be created. [ 667.266546] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.266753] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.266891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.268341] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.269137] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.269137] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.631746] env[69255]: INFO networking_nsxv3.common.synchronization [req-19c40a42-3211-4f15-bcd2-7dbb5566c443 req-a3ac8dac-7518-43aa-a552-e309fc5521d7 service nova] Enqueued Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_rules [ 668.632054] env[69255]: INFO networking_nsxv3.common.synchronization [req-19c40a42-3211-4f15-bcd2-7dbb5566c443 req-a3ac8dac-7518-43aa-a552-e309fc5521d7 service nova] Enqueued Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_members [ 668.632182] env[69255]: INFO networking_nsxv3.common.synchronization [req-19c40a42-3211-4f15-bcd2-7dbb5566c443 req-a3ac8dac-7518-43aa-a552-e309fc5521d7 service nova] Enqueued Resource ID: c9694e81-602b-40aa-82d8-f5291e24c6e0 with Priority: HIGHEST for action port [ 668.632830] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_rules [ 668.632912] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_members [ 668.636429] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9694e81-602b-40aa-82d8-f5291e24c6e0 with Priority: HIGHEST for action port [ 668.636823] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.638032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.638032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.638032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.638032] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.638702] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.638803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.638872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.639053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.639250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.639363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.639428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.639629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.639668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.639747] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.642056] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9694e81-602b-40aa-82d8-f5291e24c6e0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.642168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.643025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.643025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.643025] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9694e81-602b-40aa-82d8-f5291e24c6e0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.870654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39207596-4602-4c59-b143-d5038ebffb91 in Status: SUCCESS [ 668.870654] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39207596-4602-4c59-b143-d5038ebffb91 deletion is rescheduled due to dependency. [ 668.870654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.970020] env[69255]: INFO networking_nsxv3.common.synchronization [req-1f0ec86e-0243-419e-8ffe-c18baa97182a req-565571ce-7c5e-4af1-a58d-694febbd401f tempest-InstanceActionsTestJSON-265028220 tempest-InstanceActionsTestJSON-265028220-project-member] Enqueued Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_members [ 668.970020] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGHEST for action security_group_members [ 668.970386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.970515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.970621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.970810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.970991] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.971127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.971189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.971360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.971456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.971558] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.099016] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06344ad6-af9c-4558-b815-01d31d55ee0d in Status: SUCCESS [ 669.099016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.145133] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.145350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.145496] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9694e81-602b-40aa-82d8-f5291e24c6e0 with status ACTIVE [ 669.145674] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.145791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.145854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.147471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.147640] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.148590] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.148722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.148854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.149120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.149798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.149798] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.149798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.149798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.150050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.150168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.150313] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9694e81-602b-40aa-82d8-f5291e24c6e0 is going to be updated. [ 669.152502] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.184996] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.185318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.185511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.185692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.185828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.186588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9694e81-602b-40aa-82d8-f5291e24c6e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.482025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.482025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.482025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.482025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de is going to be updated. [ 669.518271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.518673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.518673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.518898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.519204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.529968] env[69255]: INFO networking_nsxv3.common.synchronization [req-751d134b-a5a1-44ed-a3ff-12e5a0b183df req-cb360854-49f0-4835-86e6-67c65985e84a tempest-FloatingIPsAssociationNegativeTestJSON-2022029825 tempest-FloatingIPsAssociationNegativeTestJSON-2022029825-project-member] Enqueued Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_members [ 669.530742] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGHEST for action security_group_members [ 669.531653] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.531882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.531944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.534802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.534802] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.534802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.534802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.534802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.534802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.534802] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.534802] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de in Status: IN_PROGRESS for 2s [ 669.656724] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.037650] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.037650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.037650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.037963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.037963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.038071] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.038167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.038226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.038385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.038460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.038544] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b860cf4f-f007-40a7-9732-dcaeb48217fc is going to be updated. [ 670.089706] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.090198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.090198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.090810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.090810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.101162] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b860cf4f-f007-40a7-9732-dcaeb48217fc in Status: IN_PROGRESS for 2s [ 670.161220] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.161443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.161493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.161690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.161768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.161871] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 is going to be created. [ 670.210691] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.210862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.210910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.211165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.211338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.226531] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 in Status: UNINITIALIZED for 2s [ 671.178022] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ef3a7a5f-b8c4-4e1c-94e3-c26ff2bd0243 None None] Enqueued Resource ID: 4eeb7082-771c-49a3-92eb-d9ab24d237b8 with Priority: HIGHEST for action port [ 671.178022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eeb7082-771c-49a3-92eb-d9ab24d237b8 with Priority: HIGHEST for action port [ 671.178022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eeb7082-771c-49a3-92eb-d9ab24d237b8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.178022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eeb7082-771c-49a3-92eb-d9ab24d237b8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.180231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eeb7082-771c-49a3-92eb-d9ab24d237b8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.180231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eeb7082-771c-49a3-92eb-d9ab24d237b8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.180231] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eeb7082-771c-49a3-92eb-d9ab24d237b8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.549139] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de in Status: SUCCESS [ 671.549139] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de deletion is rescheduled due to dependency. [ 671.549139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.682713] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eeb7082-771c-49a3-92eb-d9ab24d237b8 [ 671.683054] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.683491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.683491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.683781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.683781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.683912] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eeb7082-771c-49a3-92eb-d9ab24d237b8 already deleted. [ 671.683912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eeb7082-771c-49a3-92eb-d9ab24d237b8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.116888] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b860cf4f-f007-40a7-9732-dcaeb48217fc in Status: SUCCESS [ 672.117408] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b860cf4f-f007-40a7-9732-dcaeb48217fc deletion is rescheduled due to dependency. [ 672.117826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.191823] env[69255]: INFO networking_nsxv3.common.synchronization [req-f2c1330e-c80f-4e76-96e2-4fe97475bb33 req-3b530502-78f0-4c32-8c3e-e097a474a6a6 tempest-DeleteServersAdminTestJSON-1197380853 tempest-DeleteServersAdminTestJSON-1197380853-project-member] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 672.191823] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGHEST for action security_group_members [ 672.192566] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.192894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.193133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.193456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.193722] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.193968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.194314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.195602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.195820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.197359] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.239030] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 in Status: SUCCESS [ 672.239219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.239333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.239560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.241770] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.241770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.241770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.241770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.241770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.241770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.241770] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.702256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.702456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.702827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.702827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.702973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.703118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.703247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.703308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.703469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.704628] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be updated. [ 672.737689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.737879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.737924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.738196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.738289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.745325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.745784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.745869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.746108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.746302] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.746694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.746803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.747552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.747552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.747668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.747735] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.747865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.747927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.748097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.748252] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.748357] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.748786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.748950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.749050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.749140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.749232] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.751213] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: IN_PROGRESS for 2s [ 673.254380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69a6662a-ad20-4a62-a1cd-f2b43eb61276: rpc.has_security_group_logging(os_id): False [ 673.281030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.281030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.281030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.281030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.281767] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.281767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.281767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.282846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.282945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.283035] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 is going to be created. [ 673.360110] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.360110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.360110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.360743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.360743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.376134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 in Status: IN_PROGRESS for 2s [ 673.750494] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-8ed0cb3c-09f7-468c-8f3c-ead118ea3b58 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 673.751415] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 673.751747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.751870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.751933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.753504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.753911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.754080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.754424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.754424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.754551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.754658] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.838915] env[69255]: INFO networking_nsxv3.common.synchronization [None req-51b2a602-c991-4309-a862-7856180bcfb6 None None] Enqueued Resource ID: bae937ef-7ad8-42e6-bfef-de6d2cf69c4b with Priority: HIGHEST for action port [ 673.839547] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bae937ef-7ad8-42e6-bfef-de6d2cf69c4b with Priority: HIGHEST for action port [ 673.840189] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bae937ef-7ad8-42e6-bfef-de6d2cf69c4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.840189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bae937ef-7ad8-42e6-bfef-de6d2cf69c4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.840189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bae937ef-7ad8-42e6-bfef-de6d2cf69c4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.840457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bae937ef-7ad8-42e6-bfef-de6d2cf69c4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.840457] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bae937ef-7ad8-42e6-bfef-de6d2cf69c4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.158024] env[69255]: INFO networking_nsxv3.common.synchronization [None req-dfed419d-45f8-4f00-9dcc-e54c3f52df2e None None] Enqueued Resource ID: 962a5a33-f889-459c-af39-6e58b37baf90 with Priority: HIGHEST for action port [ 674.158024] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 962a5a33-f889-459c-af39-6e58b37baf90 with Priority: HIGHEST for action port [ 674.158024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-962a5a33-f889-459c-af39-6e58b37baf90 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.158024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-962a5a33-f889-459c-af39-6e58b37baf90" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.158024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-962a5a33-f889-459c-af39-6e58b37baf90" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.158024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-962a5a33-f889-459c-af39-6e58b37baf90" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.158024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962a5a33-f889-459c-af39-6e58b37baf90',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.257474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.259834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.259834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.259834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.259834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.259834] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.260287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.260287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.260287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.260287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.260589] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b already deleted. [ 674.260589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.347621] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bae937ef-7ad8-42e6-bfef-de6d2cf69c4b [ 674.347621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.347621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.347621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.347621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.347621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.347621] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bae937ef-7ad8-42e6-bfef-de6d2cf69c4b already deleted. [ 674.347621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bae937ef-7ad8-42e6-bfef-de6d2cf69c4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.401743] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-655512fd-f908-405d-98c9-0e855b3a9cc1 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 674.402170] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 674.402899] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.403436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.403436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.403582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.403637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.403897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.404803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.404803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.404803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.404803] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.658432] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 962a5a33-f889-459c-af39-6e58b37baf90 [ 674.658714] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.659179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.659179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.659179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.659331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.659331] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:962a5a33-f889-459c-af39-6e58b37baf90 already deleted. [ 674.659407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-962a5a33-f889-459c-af39-6e58b37baf90" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.770154] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a in Status: SUCCESS [ 674.770366] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a deletion is rescheduled due to dependency. [ 674.770539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.909561] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.909561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.909561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.909561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.909561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.909561] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.909561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.911432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.911432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.911432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.911432] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b already deleted. [ 674.911432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.060859] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-f52390b7-45a3-4c58-a911-cee1672a5109 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 675.063810] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 675.065850] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.065850] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.065850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.065850] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.391013] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 in Status: SUCCESS [ 675.391408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.570410] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.570410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.570410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.572874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.572874] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b already deleted. [ 675.572874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.897641] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-518 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.897836] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.897964] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.898369] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.898710] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.898827] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.898974] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.899223] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.899380] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.899584] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.899702] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.899814] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.899922] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.900060] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.900149] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.900310] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.922811] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.923123] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.923245] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.923405] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.923757] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-68faaa6a-75ec-4845-8968-8a4c38aa0a62 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.923945] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.924075] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.924446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.924621] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68faaa6a-75ec-4845-8968-8a4c38aa0a62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.431734] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.432097] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.432097] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.432586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.432586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.432751] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 68faaa6a-75ec-4845-8968-8a4c38aa0a62 not found, creating... [ 676.433014] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.433265] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.433381] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.433600] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.433733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.434105] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.434966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.435757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.435757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.435757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.435757] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 68faaa6a-75ec-4845-8968-8a4c38aa0a62 is going to be created. [ 676.458228] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.459332] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.459332] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.459332] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.459332] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.459580] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.501424] env[69255]: INFO networking_nsxv3.common.synchronization [req-49a39b4d-b97d-4dd1-a3d2-6241a149bc3a req-326e65a0-a4fd-4de9-aae1-1272b4a72517 tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 676.502508] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 676.503177] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.503177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.503364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.503605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.503998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.503998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.503998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.504174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.505653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.505653] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.011028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.011028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.011028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.011028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be updated. [ 677.013180] env[69255]: INFO networking_nsxv3.common.synchronization [None req-e2c519a3-ba1b-4170-9f1d-b0b9cd09cfb9 None None] Enqueued Resource ID: 733f87ab-09f3-468e-8a33-86c45c9354fc with Priority: HIGHEST for action port [ 677.015107] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 733f87ab-09f3-468e-8a33-86c45c9354fc with Priority: HIGHEST for action port [ 677.018048] env[69255]: INFO networking_nsxv3.common.synchronization [req-1abd664b-6ac8-4309-bea1-6f4d271b0ef1 req-14e7ae68-2b5d-400c-9ad4-4a4675b1cf33 tempest-FloatingIPsAssociationTestJSON-1412388345 tempest-FloatingIPsAssociationTestJSON-1412388345-project-member] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 677.018048] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-733f87ab-09f3-468e-8a33-86c45c9354fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.021020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-733f87ab-09f3-468e-8a33-86c45c9354fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.021020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-733f87ab-09f3-468e-8a33-86c45c9354fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.021020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-733f87ab-09f3-468e-8a33-86c45c9354fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.021020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('733f87ab-09f3-468e-8a33-86c45c9354fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.022041] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 677.023417] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.023417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.023417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.023780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.023780] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.023905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.023905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.024069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.024645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.024645] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.053040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.053040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.053040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.053829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.053995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.068450] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 677.272037] env[69255]: INFO networking_nsxv3.common.synchronization [req-c24ab4d3-c251-4443-9fdf-61f392f89e4b req-1e5cb540-9389-4d7e-9860-b8e6186ca39d tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 677.272037] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 677.272037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.272037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.272037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.272037] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.524214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 733f87ab-09f3-468e-8a33-86c45c9354fc [ 677.524214] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.524680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.524680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.524875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.525020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.525811] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:733f87ab-09f3-468e-8a33-86c45c9354fc already deleted. [ 677.525811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-733f87ab-09f3-468e-8a33-86c45c9354fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.528364] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.648984] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.648984] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.648984] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.650100] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.650513] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.650747] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.650912] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.651219] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.651411] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.651656] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.651823] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.651981] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.652129] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.652251] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.652405] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.652607] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.659262] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-eac9e0e8-dc59-4398-aa73-83b53c72569e service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 677.659441] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-eac9e0e8-dc59-4398-aa73-83b53c72569e service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 677.659580] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-eac9e0e8-dc59-4398-aa73-83b53c72569e service nova] Enqueued Resource ID: 68faaa6a-75ec-4845-8968-8a4c38aa0a62 with Priority: HIGHEST for action port [ 677.660786] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 677.660930] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 677.661035] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68faaa6a-75ec-4845-8968-8a4c38aa0a62 with Priority: HIGHEST for action port [ 677.661558] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.661816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.661816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.662088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.662170] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.664028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.664143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.664201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.664434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.664602] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.665014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.665260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.665446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.665543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.665646] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.666871] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-68faaa6a-75ec-4845-8968-8a4c38aa0a62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.666987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.667065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.667247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.667483] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68faaa6a-75ec-4845-8968-8a4c38aa0a62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.679576] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.680030] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.680030] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.680177] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.680569] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.684024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.684024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.684024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.684024] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.797969] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.797969] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.797969] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 already deleted. [ 677.797969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.032021] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.165075] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.165315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.167592] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.169044] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68faaa6a-75ec-4845-8968-8a4c38aa0a62 with status ACTIVE [ 678.169227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.169424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.169495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.169847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.169847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.170769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.170769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.170769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.170769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.170769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.170769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.170769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.170769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.171142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.171142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.171374] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68faaa6a-75ec-4845-8968-8a4c38aa0a62 is going to be updated. [ 678.184656] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.184888] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.185023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.185357] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.185486] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.185725] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e not found, creating... [ 678.186050] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.186205] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.186393] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.186550] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.186693] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.186971] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.187341] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.187469] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.187771] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.187883] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.188017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e is going to be created. [ 678.196680] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.196969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.196969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.197129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.197262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.197497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68faaa6a-75ec-4845-8968-8a4c38aa0a62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.213544] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.213991] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.214134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.214416] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.214651] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.214891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.419377] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.419577] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-228" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.419713] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-228" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.420119] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-228" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.420420] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.420667] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.420882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.421206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.421383] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.421652] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.421803] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.421934] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.422093] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.422217] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.422332] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.422467] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.443820] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.444009] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.444164] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.444361] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-228" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.444669] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-af2dbd92-9339-43fa-9145-b59b6254db63 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.444843] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.444966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.445328] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.445479] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2dbd92-9339-43fa-9145-b59b6254db63',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.534501] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.535023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.535023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.535023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.535023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.535240] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be updated. [ 678.567850] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.568103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.568170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.568431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.568659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.578702] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: IN_PROGRESS for 2s [ 678.670028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.922548] env[69255]: INFO networking_nsxv3.common.synchronization [req-c24ab4d3-c251-4443-9fdf-61f392f89e4b req-5b33a3c0-ed24-48cb-bac0-e3eec7130938 service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 678.922548] env[69255]: INFO networking_nsxv3.common.synchronization [req-c24ab4d3-c251-4443-9fdf-61f392f89e4b req-5b33a3c0-ed24-48cb-bac0-e3eec7130938 service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 678.922548] env[69255]: INFO networking_nsxv3.common.synchronization [req-c24ab4d3-c251-4443-9fdf-61f392f89e4b req-5b33a3c0-ed24-48cb-bac0-e3eec7130938 service nova] Enqueued Resource ID: 1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e with Priority: HIGHEST for action port [ 678.922548] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 678.923831] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 678.930829] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e with Priority: HIGHEST for action port [ 678.930829] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.930829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.930829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.930829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.930829] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.930829] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.930829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.930829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.930829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.932988] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.932988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.932988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.933289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.933289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.933396] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.934276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.934414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.934539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.934591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.938024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.952682] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.952847] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.952966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.953297] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.953470] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.953632] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port af2dbd92-9339-43fa-9145-b59b6254db63 not found, creating... [ 678.953894] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.954135] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.954290] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.954543] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.954687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.955939] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.956125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.956252] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.956478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.956625] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.957070] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: af2dbd92-9339-43fa-9145-b59b6254db63 is going to be created. [ 678.979618] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.979789] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.979845] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.980133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.980370] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.980603] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.079110] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 679.079259] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 deletion is rescheduled due to dependency. [ 679.079377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.175116] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.175301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.175337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.175612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.175830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.175949] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be created. [ 679.215402] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.215598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.215673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.215903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.216089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.232263] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: UNINITIALIZED for 2s [ 679.436864] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.438152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.438295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442319] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e with status ACTIVE [ 679.442522] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.442685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.442970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.443075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.443269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.443386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.443445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.443635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.443711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.443904] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.444011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.444077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.444233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.444345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.444402] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e is going to be updated. [ 679.471061] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.471061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.471061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.471489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.471489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.471489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e5e50c8-19e4-4ec0-9ec2-6dd21d75036e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.770687] env[69255]: INFO networking_nsxv3.common.synchronization [req-17d963c8-4899-4abe-af32-2dccb9bc0622 req-01aaba97-af6c-40fb-b96c-8ef6732db8f6 tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 679.771669] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 679.772161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.772418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.772580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.773072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.773340] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.773582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.773720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.775926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.775926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.775926] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.878078] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-43538f3a-26e7-4278-9255-d0f8f65b9360 service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 679.880226] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-43538f3a-26e7-4278-9255-d0f8f65b9360 service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 679.880226] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-43538f3a-26e7-4278-9255-d0f8f65b9360 service nova] Enqueued Resource ID: af2dbd92-9339-43fa-9145-b59b6254db63 with Priority: HIGHEST for action port [ 679.880226] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 679.880226] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 679.880226] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af2dbd92-9339-43fa-9145-b59b6254db63 with Priority: HIGHEST for action port [ 679.880226] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.880728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.881098] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.881346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.881839] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-af2dbd92-9339-43fa-9145-b59b6254db63 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.882050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.882211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.883573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.883573] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2dbd92-9339-43fa-9145-b59b6254db63',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.940233] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.277169] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.277424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.277506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.277781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.277891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.278111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.278214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.278277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.278436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.278516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.278602] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 already deleted. [ 680.278683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.325866] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.326076] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.326203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.326549] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.326812] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.326971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.327103] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.327329] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.327612] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.327846] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.327961] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.328084] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.328193] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.328304] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.328413] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.328545] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.350809] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.351020] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.351230] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.351618] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.352065] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-23c5e97d-1a38-4c46-a3e8-52798298f385 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.352352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.352513] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.352886] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.353087] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c5e97d-1a38-4c46-a3e8-52798298f385',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.384822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af2dbd92-9339-43fa-9145-b59b6254db63 with status ACTIVE [ 680.385145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.385293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.385358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.386015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.386015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.386015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.386224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.386224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.386368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.386457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.386708] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.386782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.386853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.387700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.387700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.387700] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af2dbd92-9339-43fa-9145-b59b6254db63 is going to be updated. [ 680.410316] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.410523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.410523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.410751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.410886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.411075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af2dbd92-9339-43fa-9145-b59b6254db63" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.443259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.443259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.443259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.443259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.443259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.443259] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be created. [ 680.476012] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.476242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.476292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.476573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.476788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.490703] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: UNINITIALIZED for 2s [ 680.588447] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 680.589362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.660722] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-518 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.660952] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.661050] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.661406] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.661799] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.661986] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.662257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.662355] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.662502] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.662714] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.662826] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.663078] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.663078] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.663163] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.663264] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.663598] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.683053] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.683186] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.683344] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.683544] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-518" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.683873] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-8734511e-0531-4d79-80a3-2775837d633e taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.684056] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.684184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.684529] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.684672] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8734511e-0531-4d79-80a3-2775837d633e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.858029] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.858029] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 23c5e97d-1a38-4c46-a3e8-52798298f385 not found, creating... [ 680.858029] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.858029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.858797] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.858797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.858797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.858797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.858797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.858797] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 23c5e97d-1a38-4c46-a3e8-52798298f385 is going to be created. [ 680.882225] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.882225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.882225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.882225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.882225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.882446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.191024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.191024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 8734511e-0531-4d79-80a3-2775837d633e not found, creating... [ 681.191024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.191024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.191478] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.191478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.191478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.191478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.191762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.192041] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 8734511e-0531-4d79-80a3-2775837d633e is going to be created. [ 681.219371] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.219371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.219371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.219371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.219371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.219371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.242108] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 681.242355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.242581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.242811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.243021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.243145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.243240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.243526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.243758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.243758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.243864] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.245336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.245495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.245707] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.245832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.245899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.246066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.246150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.246244] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.635130] env[69255]: INFO networking_nsxv3.common.synchronization [req-17d963c8-4899-4abe-af32-2dccb9bc0622 req-6179fec7-fc07-4fdf-8a98-ee71fe4eaba8 service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 681.635130] env[69255]: INFO networking_nsxv3.common.synchronization [req-17d963c8-4899-4abe-af32-2dccb9bc0622 req-6179fec7-fc07-4fdf-8a98-ee71fe4eaba8 service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 681.635130] env[69255]: INFO networking_nsxv3.common.synchronization [req-17d963c8-4899-4abe-af32-2dccb9bc0622 req-6179fec7-fc07-4fdf-8a98-ee71fe4eaba8 service nova] Enqueued Resource ID: 23c5e97d-1a38-4c46-a3e8-52798298f385 with Priority: HIGHEST for action port [ 681.635959] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 681.635959] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 681.635959] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c5e97d-1a38-4c46-a3e8-52798298f385 with Priority: HIGHEST for action port [ 681.636182] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.636732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.636732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.636825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.636859] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.637777] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.637900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.638719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.638719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.638719] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.638719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.638719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.638719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.638719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.639143] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.641245] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c5e97d-1a38-4c46-a3e8-52798298f385 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.641245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.641245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.641245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.641245] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c5e97d-1a38-4c46-a3e8-52798298f385',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.748737] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.748925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.749211] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.953286] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-08fc659c-b2bb-408f-93fc-988eafcc637f service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 681.953286] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-08fc659c-b2bb-408f-93fc-988eafcc637f service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 681.953286] env[69255]: INFO networking_nsxv3.common.synchronization [req-46629f8f-2fd2-4f4b-97de-b9aa950a2be5 req-08fc659c-b2bb-408f-93fc-988eafcc637f service nova] Enqueued Resource ID: 8734511e-0531-4d79-80a3-2775837d633e with Priority: HIGHEST for action port [ 681.953286] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 681.953286] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 681.953286] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8734511e-0531-4d79-80a3-2775837d633e with Priority: HIGHEST for action port [ 681.953702] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.953809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.958487] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.960212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.960212] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-8734511e-0531-4d79-80a3-2775837d633e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.960212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.960212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.960212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.960212] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8734511e-0531-4d79-80a3-2775837d633e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.142400] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.143075] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.143334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.143557] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23c5e97d-1a38-4c46-a3e8-52798298f385 with status ACTIVE [ 682.143716] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.143899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.143899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.144217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.144217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.144411] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.144473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.144561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.144690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.144766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.144944] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.147017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.147017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.147017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.147017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.147017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23c5e97d-1a38-4c46-a3e8-52798298f385 is going to be updated. [ 682.175331] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.175532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.175706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.175812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.175961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.176442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c5e97d-1a38-4c46-a3e8-52798298f385" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.254679] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.462435] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8734511e-0531-4d79-80a3-2775837d633e with status ACTIVE [ 682.462729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.464341] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.464341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.464341] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.464943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.464943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.464943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.464943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.464943] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8734511e-0531-4d79-80a3-2775837d633e is going to be updated. [ 682.495025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.495025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.495025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.495025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.495025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.495025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8734511e-0531-4d79-80a3-2775837d633e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.501411] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 682.501639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.501808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.502042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.502227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.502350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.502411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.502566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.502640] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.502726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.502821] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.610378] env[69255]: INFO networking_nsxv3.common.synchronization [req-5265d66c-9a0c-4c3c-845a-8d4c2094843e req-b4011f6a-e182-414a-895e-5cf1b404d543 tempest-ImagesNegativeTestJSON-210346818 tempest-ImagesNegativeTestJSON-210346818-project-member] Enqueued Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_members [ 682.612019] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGHEST for action security_group_members [ 682.612019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.612019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.612019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.612019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.612019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.612019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.612019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.612896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.613470] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.613609] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.649046] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.756758] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.756941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.756993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.757238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.757342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.757493] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 682.785592] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.785772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.785852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.786120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.786295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.796932] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 683.007316] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.008907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.008993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.009238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.009238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.009572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.009572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.009572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.009760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.009814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.009947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.010012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.010692] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.116349] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.116619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.116700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.116953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.117111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.117345] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.118401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.118401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.118531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.118594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.118726] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 is going to be updated. [ 683.153621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.153734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.153816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.154055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.154155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.154262] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be created. [ 683.164628] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.164870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.165025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.166821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.166821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.177676] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 in Status: IN_PROGRESS for 2s [ 683.208116] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.210088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.210088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.210088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.210088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.227247] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: UNINITIALIZED for 2s [ 683.515481] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3: rpc.has_security_group_logging(os_id): False [ 683.538118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.538118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.538118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.538118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.538981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.539296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.541844] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.541844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.541844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.541844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.541844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.541844] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be created. [ 683.614027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.614027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.614027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.614027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.614027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.630015] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 684.281870] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6e8ee02-cc6a-428c-9ed1-15e387562a18 req-12c0b861-c9b1-411e-9597-e3638db818d4 tempest-ServersAdminNegativeTestJSON-361636345 tempest-ServersAdminNegativeTestJSON-361636345-project-member] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 684.282493] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 684.284820] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.284964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.285032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.286029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.286029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.286029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.286029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.286029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.286029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.286029] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.788417] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.808432] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.811027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.811027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.811027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.811680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.811965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.812223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.813098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.816079] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.816079] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.816079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.816079] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.189497] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 in Status: SUCCESS [ 685.189781] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 deletion is rescheduled due to dependency. [ 685.189922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.239389] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 685.239518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.239691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.239920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.240125] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.240259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.240317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.240479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.240569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.240658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.240754] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.290985] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.319935] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fca696a-0f49-455d-9cb9-9f974821973b: rpc.has_security_group_logging(os_id): False [ 685.321087] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.360203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.360418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.360418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.360679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.362623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.362623] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.362623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.362745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.362880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.362958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.363865] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.364514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.364752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.365075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.365335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.365612] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.365822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.367642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.367642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.367642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.367642] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be created. [ 685.423182] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.423552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.423708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.423981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.424264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.436553] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 685.646401] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 685.646647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.749742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.749742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.749742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.749742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.749742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.750255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.750255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.750255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.750255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.750255] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.793653] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.793822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.793893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.794136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.794232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.794330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be updated. [ 685.823831] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.828060] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.828411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.828580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.828781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.829097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.841397] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: IN_PROGRESS for 2s [ 686.253803] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d36f190-eca4-498f-b2be-5b1977c816d8: rpc.has_security_group_logging(os_id): False [ 686.276726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.276726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.276726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.276726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.277282] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.277282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.277282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.277282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.278671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.279209] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be created. [ 686.328724] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.328724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.328724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.328724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.328724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.328724] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 686.343998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.343998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.343998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.343998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.343998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.357780] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 686.365585] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.365585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.365585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.365585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.365585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.375413] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 687.177807] env[69255]: INFO networking_nsxv3.common.synchronization [req-77df53ee-7cb1-466e-af62-6180e2319321 req-86049f5b-c998-43f3-a55d-9c962a92b7f1 tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 687.178729] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 687.179094] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.179220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.179289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.179537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.179688] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.179788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.179850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.179996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.182471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.182471] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.452587] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 687.452587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.452587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.452587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.452587] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.685476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.685894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.686096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.686410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.687623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.687623] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.687623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.687623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.687623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.687623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.687623] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 already deleted. [ 687.687623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.855822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 687.855822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.958158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.958158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.043702] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.043967] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.044148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.045048] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.045048] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.045207] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.045340] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.046089] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.046715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.047011] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.047762] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.047896] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.048057] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.048210] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.048351] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.048525] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.072266] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.072266] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.072509] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.073144] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.073144] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.073494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.073711] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.074155] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.075028] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f759ec1-5fe3-45ed-9b86-0eda16c6d905',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.373909] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 688.374267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.384927] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 688.385243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.385476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.385702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.385901] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.386288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.386415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.386671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.386777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.386907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.387188] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.577677] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.578056] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.578056] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.578752] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.578921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.579110] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5f759ec1-5fe3-45ed-9b86-0eda16c6d905 not found, creating... [ 688.579395] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.579560] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.579735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.579920] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.580187] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.580420] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.581532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.581532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.581532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.581532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.581532] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5f759ec1-5fe3-45ed-9b86-0eda16c6d905 is going to be created. [ 688.605630] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.605861] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.606066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.606395] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.606673] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.607029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.889334] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.889492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.889552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.889860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.890216] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.890361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.890557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.890739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.890809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.890871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.891069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.891200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.891258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.891415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.891598] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.891697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.891785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.891936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.892065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.892210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.892280] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.396421] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fca696a-0f49-455d-9cb9-9f974821973b: rpc.has_security_group_logging(os_id): False [ 689.419835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.419955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.420044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.420266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.420368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.420553] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.420658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.420716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.420864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.420967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.421764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.421764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.421764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.421764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.421764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.421764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.422036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.422036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.422036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.422846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425086] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 689.575858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.575858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.575858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.575858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.575858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.589802] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 689.656813] env[69255]: INFO networking_nsxv3.common.synchronization [req-77df53ee-7cb1-466e-af62-6180e2319321 req-77043ce8-c760-41cb-bdac-ea4758fbd1b7 service nova] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_rules [ 689.656988] env[69255]: INFO networking_nsxv3.common.synchronization [req-77df53ee-7cb1-466e-af62-6180e2319321 req-77043ce8-c760-41cb-bdac-ea4758fbd1b7 service nova] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 689.657135] env[69255]: INFO networking_nsxv3.common.synchronization [req-77df53ee-7cb1-466e-af62-6180e2319321 req-77043ce8-c760-41cb-bdac-ea4758fbd1b7 service nova] Enqueued Resource ID: 5f759ec1-5fe3-45ed-9b86-0eda16c6d905 with Priority: HIGHEST for action port [ 689.658254] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_rules [ 689.658490] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 689.658604] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f759ec1-5fe3-45ed-9b86-0eda16c6d905 with Priority: HIGHEST for action port [ 689.659017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.660035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.660035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.660035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.660035] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.660585] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.660708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.660772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.660963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.661129] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.661236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.661302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.661478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.661589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.661717] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.664674] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.664674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.664674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.664674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.664853] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f759ec1-5fe3-45ed-9b86-0eda16c6d905',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.038122] env[69255]: INFO networking_nsxv3.common.synchronization [req-65af497a-dd0a-4408-b43b-669dd0907f47 req-ba95af0e-3666-4653-b1da-681ad6d2afd9 tempest-ImagesOneServerTestJSON-1584038751 tempest-ImagesOneServerTestJSON-1584038751-project-member] Enqueued Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_members [ 690.038718] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e55ab758-8173-4602-9e5f-c4388eb52159 with Priority: HIGHEST for action security_group_members [ 690.038855] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e55ab758-8173-4602-9e5f-c4388eb52159 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.038975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.039553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.039803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.040019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.040176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.040252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.040449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.040544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.040649] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e55ab758-8173-4602-9e5f-c4388eb52159',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.167671] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.167791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.167978] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.170508] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f759ec1-5fe3-45ed-9b86-0eda16c6d905 with status ACTIVE [ 690.170713] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.170831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.170895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.171190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.172501] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.172729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.172845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.172912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.173110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.173193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.173383] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.173696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.173696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.173696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.173808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.173834] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f759ec1-5fe3-45ed-9b86-0eda16c6d905 is going to be updated. [ 690.195909] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.197173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.197173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.197173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.197173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.197173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f759ec1-5fe3-45ed-9b86-0eda16c6d905" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.545046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.545046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.545046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.545046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.545368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.545368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.545476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.545476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.545646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.546229] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.546229] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e55ab758-8173-4602-9e5f-c4388eb52159 is going to be updated. [ 690.590865] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.591269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.591269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.591819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.591819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.604691] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e55ab758-8173-4602-9e5f-c4388eb52159 in Status: IN_PROGRESS for 2s [ 690.671406] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.174584] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.174903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.175026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.175234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.175326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.175415] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be created. [ 691.222297] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.222297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.222297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.222424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.223817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.233567] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: UNINITIALIZED for 2s [ 691.605878] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 691.609134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.609134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.609134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.609134] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.111633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.111992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.111992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.112183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.112375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.113059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.113059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.113059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.113059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.113059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.113059] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.618041] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e55ab758-8173-4602-9e5f-c4388eb52159 in Status: SUCCESS [ 692.618041] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e55ab758-8173-4602-9e5f-c4388eb52159 deletion is rescheduled due to dependency. [ 692.618041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e55ab758-8173-4602-9e5f-c4388eb52159" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.618401] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.618401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.618401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.619171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.619171] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.619171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.619171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.619171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.619171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.619424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.619424] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.619486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.619513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.619676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.619799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.619892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.619954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.620577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.620577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.620577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.620758] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.122993] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fca696a-0f49-455d-9cb9-9f974821973b: rpc.has_security_group_logging(os_id): False [ 693.157290] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.157524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.157982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.157982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.157982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.159139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.159139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.159139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.159139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.159139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.159139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.159139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.159139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.159418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.159418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.159586] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.159714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.159812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.160116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.160308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.160308] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 693.232901] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.233131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.233131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.233318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.233467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.247380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.247380] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.247772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.247772] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.250682] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 693.750197] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.750197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.750197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.750197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.751369] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.751369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.751369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.751369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.751708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.751708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.751708] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.751808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.751808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.752276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.752276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.752276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.752276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.752594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.752594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.752594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.752691] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.007562] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa3821c8-8e85-446d-8a99-44ceb8354df9 req-8a1787e9-338c-456d-8ae7-dc32f959dd64 tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 694.008384] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 694.009749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.009749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.009749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.009749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.009749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.009749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.009749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.010276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.011126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.011126] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.256780] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a228003c-531a-43cb-9396-964ab52c0831: rpc.has_security_group_logging(os_id): False [ 694.275453] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.275616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.275687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.276542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.276542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.276542] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.276542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.276542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.276542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.276542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.276801] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.276869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.276928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.277087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.277159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.277341] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.277433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.277480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.277609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.277677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.277753] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be created. [ 694.378867] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.379212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.379296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.379587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.379886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.387178] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.387178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.387178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.387178] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.387178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.387178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387629] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.387695] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.387992] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.388878] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.389029] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.389148] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.389267] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.389374] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.389513] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.398472] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 694.419307] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.419602] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.419835] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.420169] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.421635] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.421635] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.421635] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.421635] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.422000] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f7b1ec3-f5e3-4de9-8e29-60f491cc9890',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.515180] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.925377] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.925676] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.925867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.926240] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.926421] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.926583] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 not found, creating... [ 694.926878] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.926999] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.927135] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.927392] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.927538] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.927850] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.932054] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.932331] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.932696] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.932950] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.933222] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 is going to be created. [ 694.954377] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.954634] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.954704] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.954973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.955225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.955455] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.019709] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.267027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 695.267234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.522125] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.524559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.524559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.524559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.524559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.524559] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 695.557709] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.557709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.557709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.557709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.557709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.572198] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 695.653181] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa3821c8-8e85-446d-8a99-44ceb8354df9 req-b98a8528-75cd-4418-af02-a5bd8f18622a service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 695.653181] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa3821c8-8e85-446d-8a99-44ceb8354df9 req-b98a8528-75cd-4418-af02-a5bd8f18622a service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 695.653181] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa3821c8-8e85-446d-8a99-44ceb8354df9 req-b98a8528-75cd-4418-af02-a5bd8f18622a service nova] Enqueued Resource ID: 8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 with Priority: HIGHEST for action port [ 695.653181] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 695.653181] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 695.653181] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 with Priority: HIGHEST for action port [ 695.653947] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.654106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.654175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.654565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.654657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.656221] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.656325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.656516] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.656614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.656679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.656886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.656983] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f7b1ec3-f5e3-4de9-8e29-60f491cc9890',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.860905] env[69255]: INFO networking_nsxv3.common.synchronization [req-1d730bcc-8a82-4afd-959c-a5a7d6327d7d req-0a896a42-ffeb-4e18-b54c-8613314ffb03 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 695.861446] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 695.861747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.861869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.861933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.862168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.862331] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.862433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.862491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.862707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.862769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.862829] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.160840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.160840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.161239] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 with status ACTIVE [ 696.161239] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.161365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.161365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.161771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.161884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.162092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.162191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.162958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.162958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.162958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.162958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.162958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.162958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.162958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.163393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163393] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f7b1ec3-f5e3-4de9-8e29-60f491cc9890 is going to be updated. [ 696.166644] env[69255]: INFO networking_nsxv3.common.synchronization [req-1d730bcc-8a82-4afd-959c-a5a7d6327d7d req-76a9d5dd-ddf9-4e3b-8a4c-1494e4945953 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 696.168270] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 696.168687] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.168788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.197543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.197754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.197754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.197970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.198120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.198282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f7b1ec3-f5e3-4de9-8e29-60f491cc9890" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.366348] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.413557] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 696.413854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.435642] env[69255]: INFO networking_nsxv3.common.synchronization [req-1d730bcc-8a82-4afd-959c-a5a7d6327d7d req-b2dbd42f-e026-41e2-a3b0-71d0fefc6dfc tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 696.436210] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 696.436558] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.436629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.675880] env[69255]: INFO networking_nsxv3.common.synchronization [req-13efe82b-3cfb-4faa-b526-a1c6373ef873 req-f60e79d6-05fc-457e-9b9d-22246e223210 tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 696.676549] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 696.676902] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.677556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.677692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.677994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.678179] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.678326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.678393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.679307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.679307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.679307] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.868862] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.150622] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.150913] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.151054] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.151362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.151702] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.151835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.151978] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.152428] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.152587] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.153066] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.153235] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.153354] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.153464] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.153577] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.153773] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.154042] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.178300] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.178601] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.178601] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.178773] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.179125] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.179395] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.179478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.179806] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.179908] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b19fcf-3b5c-43aa-957a-981bfbc4f00e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.181260] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.372198] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.372198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.372382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.372425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.372529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.372636] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 697.400283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.400376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.400376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.400576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.400725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.411113] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 697.582707] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 697.582940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.583129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.583354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.583541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.583653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.583756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.583939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.583994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.584099] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.683845] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.685349] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.685657] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.685894] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.686440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.686978] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.686978] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c2b19fcf-3b5c-43aa-957a-981bfbc4f00e not found, creating... [ 697.687145] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.687318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.687439] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.687671] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.687814] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.688113] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.688304] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.688483] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.688687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.688828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.689294] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c2b19fcf-3b5c-43aa-957a-981bfbc4f00e is going to be created. [ 697.708935] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.709209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.709354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.709620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.709852] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.710094] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.089441] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.191879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.192270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.192307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.192746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.192746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.192907] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be updated. [ 698.237082] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.239293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.239293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.239293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.239293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.258714] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 698.439792] env[69255]: INFO networking_nsxv3.common.synchronization [req-13efe82b-3cfb-4faa-b526-a1c6373ef873 req-534f3d7a-03eb-4345-b4e1-466a68f349f6 service nova] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_rules [ 698.441829] env[69255]: INFO networking_nsxv3.common.synchronization [req-13efe82b-3cfb-4faa-b526-a1c6373ef873 req-534f3d7a-03eb-4345-b4e1-466a68f349f6 service nova] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 698.441829] env[69255]: INFO networking_nsxv3.common.synchronization [req-13efe82b-3cfb-4faa-b526-a1c6373ef873 req-534f3d7a-03eb-4345-b4e1-466a68f349f6 service nova] Enqueued Resource ID: c2b19fcf-3b5c-43aa-957a-981bfbc4f00e with Priority: HIGHEST for action port [ 698.442883] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_rules [ 698.442883] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 698.443286] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b19fcf-3b5c-43aa-957a-981bfbc4f00e with Priority: HIGHEST for action port [ 698.443286] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.443443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.443443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.444041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.444041] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.445500] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.446354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.446967] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.448085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.448240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.448402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.448558] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b19fcf-3b5c-43aa-957a-981bfbc4f00e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.593584] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.951256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.951719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.956037] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2b19fcf-3b5c-43aa-957a-981bfbc4f00e with status ACTIVE [ 698.956037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.956037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.956037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.956037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.956037] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2b19fcf-3b5c-43aa-957a-981bfbc4f00e is going to be updated. [ 698.982151] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.982151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.982151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.982151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.982404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.983031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2b19fcf-3b5c-43aa-957a-981bfbc4f00e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.098657] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.098859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.098950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.099232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.099855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.099855] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 699.143659] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.143946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.143946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.144163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.144309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.164381] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 699.422067] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 699.422464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.422681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.422919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.423200] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.423381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.423499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.423916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.424071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.424186] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.927393] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.927604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.927604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.927826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.927915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.928126] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.928222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.928271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.928415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.928489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.928572] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 699.963868] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.964078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.964078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.964287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.964427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.977420] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 700.270799] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 700.271125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.271309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.271581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.271785] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.271899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.271964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.272139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.272222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.272316] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.775130] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.175631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 701.175631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.175631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.175869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.176124] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.176303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.176418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.176899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.176899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.177072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.177072] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.277456] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.680558] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.680804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.680883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.681428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.682125] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.682125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.682125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.682314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.682422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.682555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.682688] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.682885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.683014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.683234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.683386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.683518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.683632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.683942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.684069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.684186] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.684257] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.787546] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.787955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.787955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.788281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.788281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.788281] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be updated. [ 701.821445] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.821588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.821660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.821923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.822099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.832731] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 701.987236] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 701.987409] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b deletion is rescheduled due to dependency. [ 701.987585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.987671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.988526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.988526] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.988732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.988732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.989023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.989023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.989023] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.187720] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d36f190-eca4-498f-b2be-5b1977c816d8: rpc.has_security_group_logging(os_id): False [ 702.209289] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.209482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.209575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.210103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.210353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.210551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.210726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.210843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.213286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.213286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.213286] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.213286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.213286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.213286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.213652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.213874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.213983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.214055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.214213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.214289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.214373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 702.293552] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.293740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.293871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.294124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.294297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.307600] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 702.455166] env[69255]: INFO networking_nsxv3.common.synchronization [req-3f497850-d13a-4b39-b42b-42f7b9cdb0a0 req-4467f705-2cb7-4c9a-bac1-3299cb7f087a tempest-ServerGroupTestJSON-181692487 tempest-ServerGroupTestJSON-181692487-project-member] Enqueued Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_members [ 702.455614] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_members [ 702.455929] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.456148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.456236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.456528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.456734] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.456867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.456982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.457208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.457344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.457470] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.490948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.491343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.491484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.491938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.492166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.492423] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.492563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.492647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.492910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.493039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.493160] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 702.524983] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.524983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.524983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.524983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.524983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.536208] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 702.770234] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.770498] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-36" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.770630] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-36" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.770954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-36" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.771370] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.771547] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.771969] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.771969] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.772255] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.772438] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.772588] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.772727] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.772857] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.773025] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.773155] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.773300] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.792614] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.792987] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.792987] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.793198] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-36" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.793553] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c7866d88-3d31-4369-ac27-ae540ec23c6c taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.793746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.793969] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.794362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.794534] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7866d88-3d31-4369-ac27-ae540ec23c6c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.961121] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.961237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.961354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.961502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.961610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.961869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.962064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.962064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.962250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.962347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.962456] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca already deleted. [ 702.962582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.297747] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.298033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.298125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.298409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.298585] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.298732] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c7866d88-3d31-4369-ac27-ae540ec23c6c not found, creating... [ 703.299019] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.299193] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.299292] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.299528] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.299665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.300028] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.300203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.300301] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.300524] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.300660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.300801] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c7866d88-3d31-4369-ac27-ae540ec23c6c is going to be created. [ 703.322662] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.322869] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.322992] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.323291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.323533] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.323763] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.851095] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 703.851347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.851508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.851724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.852578] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.852721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.852776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.853019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.853133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.853271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.853408] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.281950] env[69255]: INFO networking_nsxv3.common.synchronization [req-3f497850-d13a-4b39-b42b-42f7b9cdb0a0 req-40d5e02c-e346-4d01-84b0-5b97ec088327 service nova] Enqueued Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_rules [ 704.282242] env[69255]: INFO networking_nsxv3.common.synchronization [req-3f497850-d13a-4b39-b42b-42f7b9cdb0a0 req-40d5e02c-e346-4d01-84b0-5b97ec088327 service nova] Enqueued Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_members [ 704.282365] env[69255]: INFO networking_nsxv3.common.synchronization [req-3f497850-d13a-4b39-b42b-42f7b9cdb0a0 req-40d5e02c-e346-4d01-84b0-5b97ec088327 service nova] Enqueued Resource ID: c7866d88-3d31-4369-ac27-ae540ec23c6c with Priority: HIGHEST for action port [ 704.282996] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_rules [ 704.283210] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_members [ 704.283330] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7866d88-3d31-4369-ac27-ae540ec23c6c with Priority: HIGHEST for action port [ 704.283614] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.283740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.284136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.284136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.284243] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.285106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.285229] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.285313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.285495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.285662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.285794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.285866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.286065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.286159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.286251] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.287105] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7866d88-3d31-4369-ac27-ae540ec23c6c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.287228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.287282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.287426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.287497] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7866d88-3d31-4369-ac27-ae540ec23c6c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.325373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 704.325646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.356879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.357060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.357139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.357332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.357484] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.357568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.357629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.357764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.357846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.357929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.358083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.358181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.358237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.358384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.358513] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.358608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.358662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.358796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.358887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.358966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.359150] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.550094] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 704.550516] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b deletion is rescheduled due to dependency. [ 704.551248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.788992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.789240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.789332] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.790275] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7866d88-3d31-4369-ac27-ae540ec23c6c with status ACTIVE [ 704.790455] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.790568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.790634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.790859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.790952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.791147] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.791228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.791282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.791449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.791529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.791705] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.791795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.791855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.791989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.792089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.792191] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7866d88-3d31-4369-ac27-ae540ec23c6c is going to be updated. [ 704.813746] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.813977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.814064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.814242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.814379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.814532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7866d88-3d31-4369-ac27-ae540ec23c6c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.862743] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a228003c-531a-43cb-9396-964ab52c0831: rpc.has_security_group_logging(os_id): False [ 704.886695] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.886877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.886936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.887254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.887397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.887741] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.887741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.887884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.888518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.888518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.888518] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.889193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.889193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.889193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.889193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.889326] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.889520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.889520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.889649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.889775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.889876] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be updated. [ 704.982417] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.982417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.982417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.982688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.982723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.997953] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 705.295605] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.799793] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.799993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.800046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.800292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.800411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.800562] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca is going to be created. [ 705.826944] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.827134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.827209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.827409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.827836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.838386] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca in Status: UNINITIALIZED for 2s [ 707.016373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 707.016373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.850017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca in Status: SUCCESS [ 707.850017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.850017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.850017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.850017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.850017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.850017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.850017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.850483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.850483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.850483] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.360397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.360397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.360397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.360397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.360397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.361850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.361850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.361850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.361850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.361850] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.427048] env[69255]: INFO networking_nsxv3.common.synchronization [req-200190dd-7843-4394-9b3f-db328ff4b3ed req-7040309b-add4-4f14-9d1f-8bcf08a5d786 tempest-ListServerFiltersTestJSON-530012782 tempest-ListServerFiltersTestJSON-530012782-project-member] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 708.427632] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 708.428024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.430981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.430981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.431134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.431361] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.431482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.431608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.431715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.431803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.431900] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.866793] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e308c59-2d78-4b4d-bb22-c5f49be97eca: rpc.has_security_group_logging(os_id): False [ 708.887040] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.887040] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.887040] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.888028] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.888338] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.888514] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.888651] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.888899] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.889071] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.889852] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.889989] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.890256] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.890418] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.890549] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.890662] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.893422] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.897335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.897476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.897550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.897768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.897875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.898110] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.898198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.898274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.898443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.898528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.899042] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.899042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.899042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.899042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.899264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.899297] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.899397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.899436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.899586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.899669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.899776] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca is going to be created. [ 708.920277] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.920277] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 708.920277] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.920471] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.921018] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-07aa17ef-15f5-4242-9622-29c42bd2e276 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.921294] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.921464] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.921862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.922148] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07aa17ef-15f5-4242-9622-29c42bd2e276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.938450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.938450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.938450] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 already deleted. [ 708.938450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.970164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.970164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.970164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.970164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.970164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.979857] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca in Status: IN_PROGRESS for 2s [ 709.176374] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9569c720-5315-40a0-91e8-85c92e988023 None None] Enqueued Resource ID: 879d5052-18f2-44c7-837e-0b8b8a013bc0 with Priority: HIGHEST for action port [ 709.176374] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879d5052-18f2-44c7-837e-0b8b8a013bc0 with Priority: HIGHEST for action port [ 709.176374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-879d5052-18f2-44c7-837e-0b8b8a013bc0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.176946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-879d5052-18f2-44c7-837e-0b8b8a013bc0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.177267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-879d5052-18f2-44c7-837e-0b8b8a013bc0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.177665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-879d5052-18f2-44c7-837e-0b8b8a013bc0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.177970] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('879d5052-18f2-44c7-837e-0b8b8a013bc0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.424991] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.425276] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.425932] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.425932] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.425932] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.426111] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 07aa17ef-15f5-4242-9622-29c42bd2e276 not found, creating... [ 709.427045] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.427045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.427045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.427045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.427045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.427494] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.427494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.427494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.427669] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.427785] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.427920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 07aa17ef-15f5-4242-9622-29c42bd2e276 is going to be created. [ 709.451747] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.451882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.453143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.453143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.453429] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.453704] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.681387] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 879d5052-18f2-44c7-837e-0b8b8a013bc0 [ 709.681726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.681893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.681971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.682217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.682318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.682417] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:879d5052-18f2-44c7-837e-0b8b8a013bc0 already deleted. [ 709.682495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-879d5052-18f2-44c7-837e-0b8b8a013bc0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.402722] env[69255]: INFO networking_nsxv3.common.synchronization [req-200190dd-7843-4394-9b3f-db328ff4b3ed req-4782bcce-b06d-43d8-8c55-edd88b843722 service nova] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_rules [ 710.402722] env[69255]: INFO networking_nsxv3.common.synchronization [req-200190dd-7843-4394-9b3f-db328ff4b3ed req-4782bcce-b06d-43d8-8c55-edd88b843722 service nova] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 710.402722] env[69255]: INFO networking_nsxv3.common.synchronization [req-200190dd-7843-4394-9b3f-db328ff4b3ed req-4782bcce-b06d-43d8-8c55-edd88b843722 service nova] Enqueued Resource ID: 07aa17ef-15f5-4242-9622-29c42bd2e276 with Priority: HIGHEST for action port [ 710.403153] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_rules [ 710.403339] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 710.403456] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07aa17ef-15f5-4242-9622-29c42bd2e276 with Priority: HIGHEST for action port [ 710.404246] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.404510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.404712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.406297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.406297] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.408027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.408027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.408027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.408027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.408027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.408529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.408529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.408529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.408529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.408529] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.411203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-07aa17ef-15f5-4242-9622-29c42bd2e276 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.411203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.411203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.411376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.411407] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07aa17ef-15f5-4242-9622-29c42bd2e276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.873494] env[69255]: INFO networking_nsxv3.common.synchronization [None req-5741d4fe-2d3c-4121-be08-d2f3f6b013e5 tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 710.874112] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 710.874301] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.874432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.875568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.875568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.875568] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.913399] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.913534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.914940] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07aa17ef-15f5-4242-9622-29c42bd2e276 with status ACTIVE [ 710.915175] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.915292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.915349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.915565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.915655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.915837] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.915937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.916044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.916157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.916233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.916425] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.916526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.916593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.916731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.916809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.916898] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07aa17ef-15f5-4242-9622-29c42bd2e276 is going to be updated. [ 710.918144] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.956158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.956158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.956353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.956443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.956576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.956734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07aa17ef-15f5-4242-9622-29c42bd2e276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.001391] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca in Status: SUCCESS [ 711.001391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.060356] env[69255]: INFO networking_nsxv3.common.synchronization [None req-1efd2455-7849-4cb3-ad6b-f35d50a30334 tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 711.060963] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 711.064976] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.064976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.222128] env[69255]: INFO networking_nsxv3.common.synchronization [None req-10cf6d2e-1253-4574-b781-bef16a40e32f None None] Enqueued Resource ID: 14792077-880b-413b-a879-e7ddcc1c17ef with Priority: HIGHEST for action port [ 711.223385] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14792077-880b-413b-a879-e7ddcc1c17ef with Priority: HIGHEST for action port [ 711.226214] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-14792077-880b-413b-a879-e7ddcc1c17ef taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.226214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14792077-880b-413b-a879-e7ddcc1c17ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.226214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14792077-880b-413b-a879-e7ddcc1c17ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.226214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14792077-880b-413b-a879-e7ddcc1c17ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.226214] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14792077-880b-413b-a879-e7ddcc1c17ef',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.403770] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.403924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.403992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.404284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.404371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.404477] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b already deleted. [ 711.404560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.404750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.404876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.404960] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.424335] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.479282] env[69255]: INFO networking_nsxv3.common.synchronization [None req-62717150-1c6c-41f3-a187-351bd4490400 None None] Enqueued Resource ID: ffa778d2-f36f-4a80-a757-17929f29b4e1 with Priority: HIGHEST for action port [ 711.479426] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa778d2-f36f-4a80-a757-17929f29b4e1 with Priority: HIGHEST for action port [ 711.480086] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffa778d2-f36f-4a80-a757-17929f29b4e1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.480904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffa778d2-f36f-4a80-a757-17929f29b4e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.480904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffa778d2-f36f-4a80-a757-17929f29b4e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.480904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffa778d2-f36f-4a80-a757-17929f29b4e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.480904] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa778d2-f36f-4a80-a757-17929f29b4e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.729412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14792077-880b-413b-a879-e7ddcc1c17ef [ 711.729874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.729874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.730241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.730544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.730691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731116] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14792077-880b-413b-a879-e7ddcc1c17ef already deleted. [ 711.731283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14792077-880b-413b-a879-e7ddcc1c17ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.928710] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.928710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.931628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.931628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.931628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.931628] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be created. [ 711.934059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.934059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.934059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.934431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.934431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.934431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b already deleted. [ 711.934563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.965082] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.965370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.965370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.965679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.965874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.980398] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: UNINITIALIZED for 2s [ 711.983728] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffa778d2-f36f-4a80-a757-17929f29b4e1 [ 711.983728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.983728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.983728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.983728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.983728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.983728] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffa778d2-f36f-4a80-a757-17929f29b4e1 already deleted. [ 711.983728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffa778d2-f36f-4a80-a757-17929f29b4e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.740257] env[69255]: INFO networking_nsxv3.common.synchronization [req-765400af-780c-4f95-ac99-a4206cf14de1 req-64d1a8ff-f26f-4df2-9eae-f9e39531af07 tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 712.744311] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 712.744311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.744311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.744311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.744801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.745099] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.745274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.745372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.745641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.745781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.745936] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.165641] env[69255]: INFO networking_nsxv3.common.synchronization [req-deef3067-8abb-48fe-ac1d-efae34c38d80 req-75139a8f-f0c5-4c77-9e76-a0f33e5ef0f0 tempest-ServersTestManualDisk-643603432 tempest-ServersTestManualDisk-643603432-project-member] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_members [ 713.166918] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGHEST for action security_group_members [ 713.166918] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.166918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.166918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.167213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.168056] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.168378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.168378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.168481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.168545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.168641] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.251551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.251755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.251802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.252162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.252345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.252591] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.252713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.252829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.253029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.253128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.253230] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 713.289908] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.289908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.289908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.289908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.289908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.299180] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 713.527817] env[69255]: INFO networking_nsxv3.common.synchronization [req-49baf48c-244c-41bb-9e30-5fb1f129f98c req-9e99548b-8c45-47c8-bb35-533dac59a136 tempest-ListServerFiltersTestJSON-530012782 tempest-ListServerFiltersTestJSON-530012782-project-member] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 713.527817] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 713.527973] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.527973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.673653] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.673833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.673944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.674225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.674331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.674624] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.674758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.674849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.675099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.675243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.675375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d is going to be updated. [ 713.711191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.711407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.711504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.711749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.711922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.724318] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06344ad6-af9c-4558-b815-01d31d55ee0d in Status: IN_PROGRESS for 2s [ 713.956277] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.956277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.956277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.956277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.956898] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.957297] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.957560] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.957917] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.960031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.960031] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.960031] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.960031] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.960031] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.960031] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.960031] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.960031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.985419] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.985419] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.985419] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.985419] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.985419] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.985419] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.985419] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.986365] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.986782] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9576bc6c-9eda-4f62-8a0f-77e91c202ca8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.993747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 713.994579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.995076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.995305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.995531] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.995802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.995903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.996235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.996330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.996424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.996644] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.997490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.997671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.997936] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.998070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.998162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.998385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.998723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.998723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.490413] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.490745] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.490797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.491215] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.491290] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.491532] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 9576bc6c-9eda-4f62-8a0f-77e91c202ca8 not found, creating... [ 714.491754] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.491824] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.492288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.492288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.492376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.492595] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.492746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.493357] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.493357] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.493357] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.493357] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 9576bc6c-9eda-4f62-8a0f-77e91c202ca8 is going to be created. [ 714.500290] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.500423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.501159] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.515572] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.515772] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.515898] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.516199] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.516516] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.516665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.549976] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ce41234e-23be-483b-98cc-ad21686c2e4f None None] Enqueued Resource ID: 6cab23db-eb17-4a6e-826c-d01e7edc6c2e with Priority: HIGHEST for action port [ 714.550069] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cab23db-eb17-4a6e-826c-d01e7edc6c2e with Priority: HIGHEST for action port [ 714.551033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cab23db-eb17-4a6e-826c-d01e7edc6c2e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.551033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cab23db-eb17-4a6e-826c-d01e7edc6c2e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.551033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cab23db-eb17-4a6e-826c-d01e7edc6c2e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.551033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cab23db-eb17-4a6e-826c-d01e7edc6c2e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.551422] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cab23db-eb17-4a6e-826c-d01e7edc6c2e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.003423] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.056356] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cab23db-eb17-4a6e-826c-d01e7edc6c2e [ 715.056417] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.056554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.056627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.056841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.057228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.057228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cab23db-eb17-4a6e-826c-d01e7edc6c2e already deleted. [ 715.057228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cab23db-eb17-4a6e-826c-d01e7edc6c2e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.231684] env[69255]: INFO networking_nsxv3.common.synchronization [req-49baf48c-244c-41bb-9e30-5fb1f129f98c req-e8866ff9-4f9f-4484-a6b9-5dcca87c25f2 service nova] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_rules [ 715.231684] env[69255]: INFO networking_nsxv3.common.synchronization [req-49baf48c-244c-41bb-9e30-5fb1f129f98c req-e8866ff9-4f9f-4484-a6b9-5dcca87c25f2 service nova] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 715.231790] env[69255]: INFO networking_nsxv3.common.synchronization [req-49baf48c-244c-41bb-9e30-5fb1f129f98c req-e8866ff9-4f9f-4484-a6b9-5dcca87c25f2 service nova] Enqueued Resource ID: 9576bc6c-9eda-4f62-8a0f-77e91c202ca8 with Priority: HIGHEST for action port [ 715.232056] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_rules [ 715.232200] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 715.232297] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9576bc6c-9eda-4f62-8a0f-77e91c202ca8 with Priority: HIGHEST for action port [ 715.232898] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.232997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.236396] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.236520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.236761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.236872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.236928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.237548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.237548] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9576bc6c-9eda-4f62-8a0f-77e91c202ca8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.312812] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 715.312812] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 715.312812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.512843] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.513252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.513252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.513407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.513407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.513501] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 715.545694] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.545914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.545914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.546176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.546328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.556629] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 715.736421] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06344ad6-af9c-4558-b815-01d31d55ee0d in Status: SUCCESS [ 715.736624] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d deletion is rescheduled due to dependency. [ 715.736857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.744333] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9576bc6c-9eda-4f62-8a0f-77e91c202ca8 with status ACTIVE [ 715.744580] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.744722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.744793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.745016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.745158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.745736] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.745850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.745915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.746101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.746188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.746378] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.746473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.746536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.746688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.746758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.746842] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9576bc6c-9eda-4f62-8a0f-77e91c202ca8 is going to be updated. [ 715.771088] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.771290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.771399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.771648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.771841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.772069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9576bc6c-9eda-4f62-8a0f-77e91c202ca8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.252465] env[69255]: INFO networking_nsxv3.common.synchronization [None req-2403248b-f2b0-4dc9-b60b-0331b318e06c tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: c234895e-ffaf-45ec-b395-5ccf0f6c281d with Priority: HIGHEST for action security_group_rules [ 716.253581] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c234895e-ffaf-45ec-b395-5ccf0f6c281d with Priority: HIGHEST for action security_group_rules [ 716.254092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.254762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.254949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.255596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.255596] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c234895e-ffaf-45ec-b395-5ccf0f6c281d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.362543] env[69255]: INFO networking_nsxv3.common.synchronization [None req-0980cdbf-f659-4088-97aa-41ddb2965d86 tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: c234895e-ffaf-45ec-b395-5ccf0f6c281d with Priority: HIGHEST for action security_group_rules [ 716.363119] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c234895e-ffaf-45ec-b395-5ccf0f6c281d with Priority: HIGHEST for action security_group_rules [ 716.363453] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.363565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.673349] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f41d58c-ef98-454c-a384-64e5229e08b3 req-a0e6e75d-4636-4f25-9ac3-87ee3b38c9eb tempest-ServerGroupTestJSON-181692487 tempest-ServerGroupTestJSON-181692487-project-member] Enqueued Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_members [ 716.674043] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGHEST for action security_group_members [ 716.674386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.674521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.674590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.674857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.677111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.677111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.677111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.677111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.679383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.679383] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.777303] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.778195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.778195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.779954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.779954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.779954] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c234895e-ffaf-45ec-b395-5ccf0f6c281d already deleted. [ 716.779954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.779954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.779954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.779954] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c234895e-ffaf-45ec-b395-5ccf0f6c281d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.181506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.181697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.181757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.181954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.182069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.182292] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.182387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.182475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.182601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.182678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.182764] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca is going to be updated. [ 717.211671] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.211831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.211940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.212113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.212291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.230269] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca in Status: IN_PROGRESS for 2s [ 717.302601] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.302601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.302813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.303573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.303573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.303573] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c234895e-ffaf-45ec-b395-5ccf0f6c281d already deleted. [ 717.303573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c234895e-ffaf-45ec-b395-5ccf0f6c281d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.566525] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 717.567317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.570017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.570017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.570816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.571382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.571382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.571557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.571752] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.572887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.573821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.573821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.573821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.573821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.573821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.574892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.575585] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.080613] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 023e2804-8437-4f56-a0d0-5ae5351738e3: rpc.has_security_group_logging(os_id): False [ 718.082318] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.099104] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.099273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.099350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.099532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.099628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.099831] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.099929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.099990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.100234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.100234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.100389] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.100474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.100569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.100683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.100740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.100922] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.101033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.101093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.101227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.101288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.101375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be created. [ 718.164627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.164778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.164846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.165066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.165252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.191560] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 718.586505] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.089233] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.089618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.089618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.089806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.089855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089985] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 719.117891] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.118058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.118136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.118349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.118496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.128071] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 719.241023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca in Status: SUCCESS [ 719.241222] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca deletion is rescheduled due to dependency. [ 719.241326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.206808] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 720.207075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.207237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.207462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.207553] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.685107] env[69255]: INFO networking_nsxv3.common.synchronization [req-a38444b9-c396-4a5b-9cbc-faea0f1dfcde req-2aae9d33-9f9e-4c06-9e56-89b130085f60 tempest-ListServerFiltersTestJSON-530012782 tempest-ListServerFiltersTestJSON-530012782-project-member] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 720.685722] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 720.685996] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.686134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.710568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.710839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.775428] env[69255]: INFO networking_nsxv3.common.synchronization [req-631c1c66-1f5f-4d60-8dd4-5536d9d67208 req-ca29e474-b4c0-4da7-8778-5da76302939c tempest-FloatingIPsAssociationTestJSON-1412388345 tempest-FloatingIPsAssociationTestJSON-1412388345-project-member] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 720.776049] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGHEST for action security_group_members [ 720.776314] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.776474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.776513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.776703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.776863] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.776968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.777230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.777416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.777511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.777612] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.015430] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.015697] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.015980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.016359] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.016800] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.017041] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.017190] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.017514] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.017761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.018074] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.018257] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.020762] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.020913] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.021158] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.021205] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.021314] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.042289] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.042407] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.043011] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.043011] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-931" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.043352] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-a27c29bb-947e-4013-bfc2-eab8aeb34b29 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.043891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.043891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.044033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.044181] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a27c29bb-947e-4013-bfc2-eab8aeb34b29',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.138478] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 4s [ 721.281511] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.281822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.281822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.281933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.282052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.282311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.282422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.282487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.282665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.282747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.282850] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be updated. [ 721.311934] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.312112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.312181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.312514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.312716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.323294] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: IN_PROGRESS for 2s [ 721.547068] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.547318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.547447] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.547745] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.547964] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.548145] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port a27c29bb-947e-4013-bfc2-eab8aeb34b29 not found, creating... [ 721.548411] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.548572] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.548703] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.548927] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.549080] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.549388] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.549577] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.549727] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.549966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.550127] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.550272] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: a27c29bb-947e-4013-bfc2-eab8aeb34b29 is going to be created. [ 721.573489] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.573714] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.573843] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.574285] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.574557] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.574818] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.338015] env[69255]: INFO networking_nsxv3.common.synchronization [req-a38444b9-c396-4a5b-9cbc-faea0f1dfcde req-5a67618b-b604-472a-a3b8-fe11e3e074a5 service nova] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_rules [ 722.338489] env[69255]: INFO networking_nsxv3.common.synchronization [req-a38444b9-c396-4a5b-9cbc-faea0f1dfcde req-5a67618b-b604-472a-a3b8-fe11e3e074a5 service nova] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 722.338489] env[69255]: INFO networking_nsxv3.common.synchronization [req-a38444b9-c396-4a5b-9cbc-faea0f1dfcde req-5a67618b-b604-472a-a3b8-fe11e3e074a5 service nova] Enqueued Resource ID: a27c29bb-947e-4013-bfc2-eab8aeb34b29 with Priority: HIGHEST for action port [ 722.338584] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_rules [ 722.338714] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 722.338815] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a27c29bb-947e-4013-bfc2-eab8aeb34b29 with Priority: HIGHEST for action port [ 722.339390] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.339499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.339696] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.339782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.339951] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a27c29bb-947e-4013-bfc2-eab8aeb34b29 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.340906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.340906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.341096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.341208] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a27c29bb-947e-4013-bfc2-eab8aeb34b29',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.844155] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a27c29bb-947e-4013-bfc2-eab8aeb34b29 with status ACTIVE [ 722.844396] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.844602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.844673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.844993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.844993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.845183] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.845287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.845346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.845526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.845628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.845919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.845919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.846031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.846116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.846193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.846288] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a27c29bb-947e-4013-bfc2-eab8aeb34b29 is going to be updated. [ 722.867827] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.867980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.868083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.868264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.868426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.868669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a27c29bb-947e-4013-bfc2-eab8aeb34b29" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.149805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 723.149983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.150188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.150420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.150761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.150901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.151028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.152108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.152108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.152108] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.335049] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2949be13-f858-4157-91a1-664036bdd8ee in Status: SUCCESS [ 723.335236] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2949be13-f858-4157-91a1-664036bdd8ee deletion is rescheduled due to dependency. [ 723.335350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.655595] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.157998] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.666627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.666627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.666627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.667052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.667052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.667117] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 724.698792] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.698954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.699033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.699326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.699419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.713494] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 726.726838] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 726.727262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.727262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.727475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.727669] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.727790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.727975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.728040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.728110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.728177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.728294] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.729208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.729379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.729537] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.729642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.729720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.729914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.729914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.730088] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.219084] env[69255]: INFO networking_nsxv3.common.synchronization [req-acb637d4-780a-425e-b36d-cd339b59d56c req-df05ee20-8f02-4086-9618-2570de37ce22 tempest-ServersTestBootFromVolume-1949505041 tempest-ServersTestBootFromVolume-1949505041-project-member] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_members [ 727.219721] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGHEST for action security_group_members [ 727.220069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.220192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.220346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.220552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.220801] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.220961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.221078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.221341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.221508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.221668] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.232639] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.232639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.232853] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.720106] env[69255]: INFO networking_nsxv3.common.synchronization [req-317fcac6-2532-44e8-9865-05f7a611f6d0 req-a2b10dac-16ee-414c-83b8-e4f8eb82d104 tempest-ServersAdminNegativeTestJSON-361636345 tempest-ServersAdminNegativeTestJSON-361636345-project-member] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 727.720669] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGHEST for action security_group_members [ 727.722064] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.722214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.722285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.722492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.722692] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.722808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.722872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.723042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.723137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.723309] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.724429] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.724540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.724683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.724852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.724996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.725146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.725241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.726538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.726748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.726842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.727107] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e is going to be updated. [ 727.739121] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.773961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.774421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.774421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.774516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.774723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.785760] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e in Status: IN_PROGRESS for 2s [ 727.879400] env[69255]: INFO networking_nsxv3.common.synchronization [req-c010e759-a3ed-4843-9354-b3b03586d349 req-42980eb6-5134-4d02-b570-73d60be3cbd5 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 727.884425] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 727.884979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.885216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.885285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.893025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.893025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.893025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.893025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.893025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.893025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.893025] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.229301] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.230302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.230302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.230302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.230302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.230302] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.230302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.230302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.230659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.230659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.230659] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be updated. [ 728.241357] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.241524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.241608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.241816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.241913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.242022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 728.271400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.271550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.271614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.271847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.272009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.274121] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.274241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.274315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.274673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.275254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.283978] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: IN_PROGRESS for 2s [ 728.284697] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 728.340107] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.340355] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.340545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.340884] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.341113] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.341277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.341393] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.341618] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.341773] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.342029] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.342151] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.342264] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.342370] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.342500] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.342584] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.342714] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.362435] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.362435] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.362435] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.362687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.362953] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-63411f23-0bca-434b-9b44-d2074413c19a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.363142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.363263] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.363651] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.363797] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63411f23-0bca-434b-9b44-d2074413c19a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.389623] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.389623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.389806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.390136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.390247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.390536] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.390724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.390791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.390969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.391131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.391913] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 728.419988] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.420214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.420308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.420571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.420753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.430942] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 728.868934] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.868934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.868934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.869328] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.869328] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.869403] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 63411f23-0bca-434b-9b44-d2074413c19a not found, creating... [ 728.869661] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.869825] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.869955] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.870189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.870329] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.870607] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.870772] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.870942] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.871109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.871242] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.871384] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 63411f23-0bca-434b-9b44-d2074413c19a is going to be created. [ 728.894034] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.894213] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.894339] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.894687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.894946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.895193] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.635962] env[69255]: INFO networking_nsxv3.common.synchronization [req-c010e759-a3ed-4843-9354-b3b03586d349 req-f06c832a-b639-4287-91b3-1f8823ec18ef service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 729.636165] env[69255]: INFO networking_nsxv3.common.synchronization [req-c010e759-a3ed-4843-9354-b3b03586d349 req-f06c832a-b639-4287-91b3-1f8823ec18ef service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 729.636306] env[69255]: INFO networking_nsxv3.common.synchronization [req-c010e759-a3ed-4843-9354-b3b03586d349 req-f06c832a-b639-4287-91b3-1f8823ec18ef service nova] Enqueued Resource ID: 63411f23-0bca-434b-9b44-d2074413c19a with Priority: HIGHEST for action port [ 729.636539] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 729.636669] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 729.636774] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63411f23-0bca-434b-9b44-d2074413c19a with Priority: HIGHEST for action port [ 729.637606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.637972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.638059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.638406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.638493] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.639329] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.639417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.639737] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-63411f23-0bca-434b-9b44-d2074413c19a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.639848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.639911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.640092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.640166] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63411f23-0bca-434b-9b44-d2074413c19a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.796650] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e in Status: SUCCESS [ 729.796650] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e deletion is rescheduled due to dependency. [ 729.796884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.142320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.142320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.145583] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63411f23-0bca-434b-9b44-d2074413c19a with status ACTIVE [ 730.145583] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.145583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.145583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.145583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.145583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.145583] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.146104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.146104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.146104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.146104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.146104] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.146262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.146262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.146358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.146427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.146523] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63411f23-0bca-434b-9b44-d2074413c19a is going to be updated. [ 730.170329] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.170495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.170631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.170837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.170981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.171138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63411f23-0bca-434b-9b44-d2074413c19a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.295668] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 730.295953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.296194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.296434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.296846] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.296932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.296987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.297227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.297328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.297444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.297689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.297818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.297913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.298125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.298304] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.298410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.298508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.298703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.298810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.298915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.299086] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.300641] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 in Status: SUCCESS [ 730.300819] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 deletion is rescheduled due to dependency. [ 730.300929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.441150] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 730.441482] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 730.441673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.441935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.442271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.442543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.442721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.442827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.443197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.443346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.443498] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.802369] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 023e2804-8437-4f56-a0d0-5ae5351738e3: rpc.has_security_group_logging(os_id): False [ 730.820875] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.821171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.821258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.821442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.821587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.821735] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.821841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.821900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.822073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.822154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.822349] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.822446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.822515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.822647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.822744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.822934] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.823231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.823328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.823474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.823553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.823643] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 730.896482] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.896482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.896676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.896809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.896988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.917832] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 730.946018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.453221] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.617419] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ee2780e-9655-410d-89b0-743ddc15da90 req-45d9ee11-16a6-48a7-abb9-0148cb4232c8 tempest-ServersNegativeTestJSON-1716894594 tempest-ServersNegativeTestJSON-1716894594-project-member] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 731.620558] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 731.621027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.621207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.621302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.621614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.621942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.622344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.622440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.622659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.622898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.622898] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.961179] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.961635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.961865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.962212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.964068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.964068] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 731.996226] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.996226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.996226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.996226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.996226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.004652] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 732.127296] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.127296] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.127296] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 already deleted. [ 732.127296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.405934] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.406166] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.406295] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.408341] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.408678] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.408852] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.408978] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.409236] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.409388] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.409611] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.409729] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.409839] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.409949] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.410070] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.410177] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.410310] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.435319] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.435466] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.435565] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.435781] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.436122] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-6641a375-773a-4e77-93b5-e8cba418b05d taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.436307] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.436430] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.436780] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.436960] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6641a375-773a-4e77-93b5-e8cba418b05d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.932690] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 732.933026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.933228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.933460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.933553] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.938838] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.939047] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.939179] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.939441] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.939617] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.939851] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 6641a375-773a-4e77-93b5-e8cba418b05d not found, creating... [ 732.940285] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.941042] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.941042] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.941169] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.941330] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.941791] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.942203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.942440] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.942786] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.942890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.943138] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 6641a375-773a-4e77-93b5-e8cba418b05d is going to be created. [ 732.965058] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.965270] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.965337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.965608] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.965884] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.966164] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.436395] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.436590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.436632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.436831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.436997] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.437114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.437204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.437367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.437424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.437489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.437579] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.940586] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.941628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.941770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.941979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.942306] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.942499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.942551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.942757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.942854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.942948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.943141] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.943245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.943310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.943461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.944440] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.944651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.944854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.945062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.945209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.945361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.945861] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.990735] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ee2780e-9655-410d-89b0-743ddc15da90 req-f42dcf07-a331-49c1-ad54-0067ad4fa526 service nova] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_rules [ 733.990918] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ee2780e-9655-410d-89b0-743ddc15da90 req-f42dcf07-a331-49c1-ad54-0067ad4fa526 service nova] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 733.991073] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ee2780e-9655-410d-89b0-743ddc15da90 req-f42dcf07-a331-49c1-ad54-0067ad4fa526 service nova] Enqueued Resource ID: 6641a375-773a-4e77-93b5-e8cba418b05d with Priority: HIGHEST for action port [ 733.991685] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_rules [ 733.991825] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 733.991925] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6641a375-773a-4e77-93b5-e8cba418b05d with Priority: HIGHEST for action port [ 733.996026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.996193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.996263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.996565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.996691] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.998012] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.998144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.998214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.998402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.998551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.998649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.998713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.998867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.998949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.999436] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.000683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6641a375-773a-4e77-93b5-e8cba418b05d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.000683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.000774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.000865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.000949] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6641a375-773a-4e77-93b5-e8cba418b05d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.020524] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 734.020686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.021112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.021330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.021580] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.021743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.021828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.021990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.022088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.022173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.022266] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.116699] env[69255]: INFO networking_nsxv3.common.synchronization [None req-071c70e6-b8c6-4a93-9a4e-b30d2992fc30 tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_rules [ 734.117274] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_rules [ 734.117623] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.117693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.117745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.118700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.118837] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.233097] env[69255]: INFO networking_nsxv3.common.synchronization [None req-30f0010b-d76b-40a8-9894-8ea4a14d1c4d tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_rules [ 734.235571] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_rules [ 734.236103] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.236341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.453947] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 023e2804-8437-4f56-a0d0-5ae5351738e3: rpc.has_security_group_logging(os_id): False [ 734.473936] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.473936] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.473936] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.473936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.474564] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.474564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.474564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.474564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.474564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.474564] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 734.503806] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.504310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.504608] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.507021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6641a375-773a-4e77-93b5-e8cba418b05d with status ACTIVE [ 734.507021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.507021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.507021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.507969] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.508336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.508496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.508795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.508996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.509185] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6641a375-773a-4e77-93b5-e8cba418b05d is going to be updated. [ 734.529572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.529572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.529572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.529572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.529572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.530248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.530248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.530248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.530248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.530248] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.531822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.532211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.532383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.532633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.532861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.533114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.543200] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.543200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.543200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.543362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.543870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.557315] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 734.664998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.665193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.665193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.665686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.665686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.665686] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 already deleted. [ 734.665686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.666033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.666033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.666122] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.013077] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.031834] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 735.054369] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.054506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.054575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.054978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.054978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.058997] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.058997] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.058997] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.058997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.059742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.059742] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 735.139224] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.139224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.139224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.139224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.139224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.153284] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 735.192250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.192395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.192466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.192682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.192774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.193322] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 already deleted. [ 735.193322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.514568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.514729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.514788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.515511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.515511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.515511] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be created. [ 735.541364] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.541364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.541364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.541364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.541364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.550685] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: UNINITIALIZED for 2s [ 736.575813] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 736.575813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.632064] env[69255]: INFO networking_nsxv3.common.synchronization [req-77663f87-e8ca-416e-b25a-1020b4b9591c req-e45f3604-6a66-4221-8fff-1f5c0c540f41 tempest-MigrationsAdminTest-1462281717 tempest-MigrationsAdminTest-1462281717-project-member] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 736.632706] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 736.633010] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.633111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.633148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.633406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.633559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.633719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.633719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.633961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.633961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.637123] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.141453] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.141453] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.141453] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a already deleted. [ 737.141453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.169058] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 737.169058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.191180] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.191180] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.191180] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.191460] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.191893] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.191893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.191893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.192115] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.192257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.192492] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.192610] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.192719] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.192826] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.193022] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.193147] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.193284] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.216318] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.216684] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.218061] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.218250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.221283] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.221283] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.221283] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.221283] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.221283] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.560806] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 737.561572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.561572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.561572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.561751] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.561856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.561943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.562141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.562256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.562383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.562494] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.723267] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.723613] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.723734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.723980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.724248] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.724440] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 not found, creating... [ 737.724805] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.725108] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.725506] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.725667] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.725884] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.726375] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.726567] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.726713] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.726965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.727166] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.727392] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 is going to be created. [ 737.749043] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.749256] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.749256] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.749546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.749781] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.750013] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.069707] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.069926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.070016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.070257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.070437] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.070593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.070593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.070736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.070823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.070911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.071210] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.071210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.071210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.071355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.071474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.071560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.071712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.071757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.071814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.071891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.071981] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.574900] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d629ccb4-175d-4e83-941e-35fb3996c7a9: rpc.has_security_group_logging(os_id): False [ 738.599639] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.599639] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.599639] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.599639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.600295] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.600295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.600295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.600295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.600781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.600896] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be created. [ 738.666563] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.666708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.666775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.667275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.667403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.670453] env[69255]: INFO networking_nsxv3.common.synchronization [req-77663f87-e8ca-416e-b25a-1020b4b9591c req-9ee15c35-9998-418a-bc50-e7a7860be196 service nova] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_rules [ 738.670628] env[69255]: INFO networking_nsxv3.common.synchronization [req-77663f87-e8ca-416e-b25a-1020b4b9591c req-9ee15c35-9998-418a-bc50-e7a7860be196 service nova] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 738.670762] env[69255]: INFO networking_nsxv3.common.synchronization [req-77663f87-e8ca-416e-b25a-1020b4b9591c req-9ee15c35-9998-418a-bc50-e7a7860be196 service nova] Enqueued Resource ID: ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 with Priority: HIGHEST for action port [ 738.671279] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_rules [ 738.671423] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 738.671516] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 with Priority: HIGHEST for action port [ 738.671776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.671914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.671961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.672221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.672273] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.673307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.673307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.673307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.673460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.673633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.673682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.673712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.673919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.673919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.674057] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.674908] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.675039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.675111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.675258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.675339] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.684534] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 739.179696] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.179961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.180052] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 with status ACTIVE [ 739.182448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.182448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.182448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.182448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.182448] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57 is going to be updated. [ 739.187018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.211081] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.212213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.212298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.212529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.212710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.212886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2fc6f5-1392-4fdb-bf1e-7c9a45305b57" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.686332] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.194021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.194021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.194021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.194021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.194021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.194021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be created. [ 740.225512] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.225667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.225730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.226063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.226285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.239320] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: UNINITIALIZED for 2s [ 740.700193] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 740.700363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.248870] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 742.249170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.249216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.250030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.250123] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.250362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.250434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.250590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.250676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.250760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.250852] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.753567] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.753995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.753995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.754312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.754543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.754700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.754814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.755059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.755255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.755427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.755657] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.755803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.755897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.756099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.756305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.756448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.756545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.756773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.757039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.757194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.757333] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.260034] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1cc7026-1d45-4ec0-a32d-311a913b774a: rpc.has_security_group_logging(os_id): False [ 743.280259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.281280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.281280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.281280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.281280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.281686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.281834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.281911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.282075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.282163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.282365] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.282463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.282525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.282665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.282739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.282946] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.283071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.283154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.283309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.283387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.283472] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be created. [ 743.346381] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.346616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.346745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.346990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.347237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.363657] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: IN_PROGRESS for 2s [ 743.673793] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 743.673793] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 745.379958] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 745.380248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.765899] env[69255]: INFO networking_nsxv3.common.synchronization [req-07ae7956-9935-4ce2-8792-8e333dd57da1 req-a1a7ad1f-b147-44b9-acd6-9cbdf4cc6d19 tempest-ListServerFiltersTestJSON-530012782 tempest-ListServerFiltersTestJSON-530012782-project-member] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 747.766539] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 747.767194] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.767194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.767194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.767408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.767408] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.767527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.767579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.768391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.768391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.768391] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.270074] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.772169] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.275716] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.276248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.276389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.276639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.276740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.276846] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 749.308847] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.309017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.309067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.309284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.309541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.319502] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 751.030211] env[69255]: INFO networking_nsxv3.common.synchronization [req-e72f7340-f664-4a9d-a1a9-2816f742a35d req-91bcaa63-2d2a-4d57-b9ea-12ca6ddf07ee tempest-ServerActionsV293TestJSON-738517794 tempest-ServerActionsV293TestJSON-738517794-project-member] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_members [ 751.030830] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_members [ 751.031144] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.031269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.031336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.031597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.031761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.032027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.032027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.032964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.032964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.032964] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.333451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 751.333451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.345286] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-240 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.345531] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-240" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.345882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-240" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.346018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-240" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.346326] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.346494] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.346613] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.346856] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.347034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.347464] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.347588] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.347697] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.347807] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.347919] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.348029] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.348173] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.372147] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.372147] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.372147] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.372147] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-240" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.372147] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.372147] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.372147] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.372147] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.372712] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.539240] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.539430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.539530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.539826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.539885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.540201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.540308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.540359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.540553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.540652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.540759] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf already deleted. [ 751.540845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.875928] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.876536] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.876790] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.877237] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.877515] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.877778] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 not found, creating... [ 751.878214] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.878507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.878709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.879104] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.879347] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.879852] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.880132] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.880342] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.880681] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.880890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.881144] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 is going to be created. [ 751.904012] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.904375] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.904375] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.904638] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.904880] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.905312] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.842803] env[69255]: INFO networking_nsxv3.common.synchronization [req-e72f7340-f664-4a9d-a1a9-2816f742a35d req-d8fca738-30fb-499e-af6f-736329992d04 service nova] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_rules [ 752.843116] env[69255]: INFO networking_nsxv3.common.synchronization [req-e72f7340-f664-4a9d-a1a9-2816f742a35d req-d8fca738-30fb-499e-af6f-736329992d04 service nova] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_members [ 752.843162] env[69255]: INFO networking_nsxv3.common.synchronization [req-e72f7340-f664-4a9d-a1a9-2816f742a35d req-d8fca738-30fb-499e-af6f-736329992d04 service nova] Enqueued Resource ID: 6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 with Priority: HIGHEST for action port [ 752.844520] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_rules [ 752.844520] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_members [ 752.844520] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 with Priority: HIGHEST for action port [ 752.844520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.844520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.844520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.844800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.844800] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.845498] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.845619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.845685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.845846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.845991] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.846096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.846157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.846322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.846416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.846517] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.847274] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.847444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.847517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.847761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.847761] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.349787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.349919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.350147] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.352289] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 with status ACTIVE [ 753.353049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.353049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.353049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.353049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.353049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.353530] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.353530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.353530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.353530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.353530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.353739] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.353826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.353891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.354043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.354128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.354214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019 is going to be updated. [ 753.370405] env[69255]: INFO networking_nsxv3.common.synchronization [req-db58021c-3e90-40d8-bbcb-f2e1ad6f1c76 req-90616308-6e1e-4663-9146-aac18f4c8079 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 753.370906] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 753.371551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.371551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.371551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.371717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.371748] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.372163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.372163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.372163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.372163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.372423] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.376371] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.376371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.377380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.377380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.377380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.377380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ecd37e5-4fbf-4dc0-91e7-2c1c7d897019" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.812247] env[69255]: INFO networking_nsxv3.common.synchronization [req-132360f4-cd20-4380-b383-a0a5a635aff6 req-9186bbc6-ce67-4747-a345-f4363248656e tempest-TenantUsagesTestJSON-805327794 tempest-TenantUsagesTestJSON-805327794-project-member] Enqueued Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_members [ 753.812770] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_members [ 753.813078] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.813203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.813271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.813520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.813676] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.813776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.813839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.813993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.814090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.814182] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.852599] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.875317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.875317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.875317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.875604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.875604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.875710] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.875810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.875870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.876084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.876122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.876183] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 753.909973] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.909973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.909973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.909973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.909973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.920065] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 754.150727] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.150727] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.150727] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.150727] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.150727] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.150727] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.151058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.151058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.151606] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.151849] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.152158] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.152343] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.152583] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.153192] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.153192] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.153192] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.174685] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.174915] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.174982] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.175176] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.175483] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.175734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.175857] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.176206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.176350] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.319473] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.319639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.319713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.319935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.320046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.320284] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.320351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.320386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.320545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.320629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.320712] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d already deleted. [ 754.320791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.355310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.356083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.356083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.356083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.356083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.356083] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf is going to be created. [ 754.379691] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.379824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.379867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.380073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.380233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.404626] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64182064-3f41-4201-905f-0777a4b2f9cf in Status: UNINITIALIZED for 2s [ 754.678919] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.679913] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.679913] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.679913] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.679913] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.679913] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a not found, creating... [ 754.680321] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.680321] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.680412] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.681023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.681023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.681023] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.681205] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.681285] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.682102] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.682102] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.682102] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a is going to be created. [ 754.703447] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.703678] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.703805] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.704112] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.704360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.704590] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.442919] env[69255]: INFO networking_nsxv3.common.synchronization [req-132360f4-cd20-4380-b383-a0a5a635aff6 req-c699ef8a-6f43-466f-800d-3d454ca04ec9 service nova] Enqueued Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_rules [ 755.442919] env[69255]: INFO networking_nsxv3.common.synchronization [req-132360f4-cd20-4380-b383-a0a5a635aff6 req-c699ef8a-6f43-466f-800d-3d454ca04ec9 service nova] Enqueued Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_members [ 755.443308] env[69255]: INFO networking_nsxv3.common.synchronization [req-132360f4-cd20-4380-b383-a0a5a635aff6 req-c699ef8a-6f43-466f-800d-3d454ca04ec9 service nova] Enqueued Resource ID: d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a with Priority: HIGHEST for action port [ 755.444022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_rules [ 755.444383] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_members [ 755.445049] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a with Priority: HIGHEST for action port [ 755.445049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.445049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.445291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.445621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.445714] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.446787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.446977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.447115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.447346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.447576] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.447783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.447880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.448125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.448276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.448409] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.449463] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.452183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.452257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.452502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.452554] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.930123] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 755.930345] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 755.930475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.955041] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.956417] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.956546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.956877] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a with status ACTIVE [ 755.957225] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.957225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.957352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.957474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.957566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.957734] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.957830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.957892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.958694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.958694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.958694] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.958856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.958856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.959290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.959493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.959592] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a is going to be updated. [ 755.981409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.981409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.981409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.981707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.981707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.981845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0c7fb3c-7b7e-4b3b-96aa-2e395f727d2a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.416209] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64182064-3f41-4201-905f-0777a4b2f9cf in Status: SUCCESS [ 756.416535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.416812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.417284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.417461] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.417602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.417674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.417871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.418012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.418122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.418232] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.461574] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.921028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.963567] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.964695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.964695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.964695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.964695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.964695] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d is going to be created. [ 756.989966] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.990180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.990259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.990470] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.990629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.002427] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d in Status: UNINITIALIZED for 2s [ 757.423065] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64182064-3f41-4201-905f-0777a4b2f9cf: rpc.has_security_group_logging(os_id): False [ 757.444551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.444773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.444878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.445187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.445325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.445773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.445941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.446058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.446295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.446418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.446545] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf is going to be created. [ 757.536301] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.536301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.536301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.536766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.536766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.549160] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64182064-3f41-4201-905f-0777a4b2f9cf in Status: IN_PROGRESS for 2s [ 759.012111] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d in Status: SUCCESS [ 759.012420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.012517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.012732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.012924] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.013050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.013117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.013268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.013351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.013496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.013591] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.134964] env[69255]: INFO networking_nsxv3.common.synchronization [req-477228de-5c95-4d0e-abdc-a7ff0f765575 req-404f91e4-e03f-4532-a0e0-6635e92dd6df tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 759.136447] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 759.136447] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.136447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.136447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.136447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.137923] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.137923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.137923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.137923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.137923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.137923] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.515949] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.516139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.516212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.516428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.516598] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.516696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.516757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.516960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.517067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.517157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.517310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.517401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.517460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.517598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.517731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.517823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.517883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.518045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.518105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.518249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.518297] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.561563] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64182064-3f41-4201-905f-0777a4b2f9cf in Status: SUCCESS [ 759.561802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.640773] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.852260] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.852479] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.852718] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.853130] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.853809] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.854040] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.854206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.856630] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.856630] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.856630] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.856630] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.856630] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.856630] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.856630] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.856630] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.856630] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.877379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.877563] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.877563] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.878656] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.878656] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5b124940-27d6-4e82-81ce-e7d3359ef646 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.878656] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.878656] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.878940] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.878940] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b124940-27d6-4e82-81ce-e7d3359ef646',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.021397] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c48731-e921-4ad3-bc4e-fd9859b1fb0d: rpc.has_security_group_logging(os_id): False [ 760.040889] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.041131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.041240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.041492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.041612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.041827] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.041974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.042310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.042538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.042654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.042947] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.043067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.043260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.043443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.043548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.043776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.043902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.044068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.044255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.044355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.044560] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d is going to be created. [ 760.101776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.103776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.103915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.104184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.104378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.115995] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d in Status: IN_PROGRESS for 2s [ 760.144163] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.382539] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.382704] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.382822] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.383404] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.384291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.384291] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5b124940-27d6-4e82-81ce-e7d3359ef646 not found, creating... [ 760.384291] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.384291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.384430] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.384660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.384769] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.385088] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.385288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.385368] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.385643] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.385746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.386189] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5b124940-27d6-4e82-81ce-e7d3359ef646 is going to be created. [ 760.415318] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.415318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.415318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.415560] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.415722] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.416051] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.646384] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.646599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.647717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.648088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.648224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.648385] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 760.683140] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.684186] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.685221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.685221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.685221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.695295] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 761.374642] env[69255]: INFO networking_nsxv3.common.synchronization [req-477228de-5c95-4d0e-abdc-a7ff0f765575 req-fd9e527b-e1f6-4c98-a146-042494c57ef5 service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 761.374901] env[69255]: INFO networking_nsxv3.common.synchronization [req-477228de-5c95-4d0e-abdc-a7ff0f765575 req-fd9e527b-e1f6-4c98-a146-042494c57ef5 service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 761.378163] env[69255]: INFO networking_nsxv3.common.synchronization [req-477228de-5c95-4d0e-abdc-a7ff0f765575 req-fd9e527b-e1f6-4c98-a146-042494c57ef5 service nova] Enqueued Resource ID: 5b124940-27d6-4e82-81ce-e7d3359ef646 with Priority: HIGHEST for action port [ 761.378163] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 761.378163] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 761.378163] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b124940-27d6-4e82-81ce-e7d3359ef646 with Priority: HIGHEST for action port [ 761.378163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.378163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.378163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.378163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.378163] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.378543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.378543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.378543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b124940-27d6-4e82-81ce-e7d3359ef646 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.378543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.378746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.378778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.378857] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b124940-27d6-4e82-81ce-e7d3359ef646',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.884389] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.884547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.884848] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b124940-27d6-4e82-81ce-e7d3359ef646 with status ACTIVE [ 761.884916] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.885045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.885109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.885321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.885420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.885582] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.885673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.885736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.886162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.886162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.887642] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.887642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.887642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.887642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.887642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.889645] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b124940-27d6-4e82-81ce-e7d3359ef646 is going to be updated. [ 761.915434] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.916435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.916435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.916633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.916790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.916990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b124940-27d6-4e82-81ce-e7d3359ef646" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.070219] env[69255]: INFO networking_nsxv3.common.synchronization [req-dafa958b-020a-44d4-b4f4-f323beb245e8 req-86bc29e6-df05-4681-933a-1a8a32f27e6d tempest-ListImageFiltersTestJSON-574574432 tempest-ListImageFiltersTestJSON-574574432-project-member] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 762.071163] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 762.072071] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.073164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.073164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.073164] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.129779] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d in Status: SUCCESS [ 762.129881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.515322] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.515661] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.515661] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.516653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.516653] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.516653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.516653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.517035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.517035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.519228] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.519387] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.519509] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.519626] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.519745] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.519858] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.519999] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.539468] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.539672] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.539778] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.539947] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.541984] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-56845eac-cd78-4268-bbf3-b5034d7128e3 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.541984] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.541984] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.541984] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.541984] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56845eac-cd78-4268-bbf3-b5034d7128e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.577101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.577260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.577260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.577704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.577704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.577819] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.577819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.577915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.578387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.578387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.578387] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 already deleted. [ 762.578387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.706126] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 762.706544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.706631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.706782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.706978] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.707097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.707159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.707458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.707556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.707657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.043589] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.043828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.043961] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.044268] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.044426] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.044788] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 56845eac-cd78-4268-bbf3-b5034d7128e3 not found, creating... [ 763.044862] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.045171] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.045171] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.045610] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.045610] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.045815] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.045985] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.046112] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.046354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.046497] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.046643] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 56845eac-cd78-4268-bbf3-b5034d7128e3 is going to be created. [ 763.068651] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.068893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.069025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.069303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.069540] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.069851] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.209516] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.713555] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.922260] env[69255]: INFO networking_nsxv3.common.synchronization [req-dafa958b-020a-44d4-b4f4-f323beb245e8 req-9ba348a5-0651-407b-9858-94b39b822c49 service nova] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_rules [ 763.922486] env[69255]: INFO networking_nsxv3.common.synchronization [req-dafa958b-020a-44d4-b4f4-f323beb245e8 req-9ba348a5-0651-407b-9858-94b39b822c49 service nova] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 763.922631] env[69255]: INFO networking_nsxv3.common.synchronization [req-dafa958b-020a-44d4-b4f4-f323beb245e8 req-9ba348a5-0651-407b-9858-94b39b822c49 service nova] Enqueued Resource ID: 56845eac-cd78-4268-bbf3-b5034d7128e3 with Priority: HIGHEST for action port [ 763.922863] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_rules [ 763.922992] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 763.923118] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56845eac-cd78-4268-bbf3-b5034d7128e3 with Priority: HIGHEST for action port [ 763.923682] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.923840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.923905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.926264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.926423] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.931101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.931423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.931423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.931592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.931769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.931929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.931929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.932102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.932193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.932289] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.935227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-56845eac-cd78-4268-bbf3-b5034d7128e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.935227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.935227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.935227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.935227] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56845eac-cd78-4268-bbf3-b5034d7128e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.218568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.218741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.218816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.219032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.219136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.219260] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 764.247791] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.247933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.248054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.248228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.249106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.261358] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 764.436045] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.436045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.436045] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.436894] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56845eac-cd78-4268-bbf3-b5034d7128e3 with status ACTIVE [ 764.437152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.437280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.437530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.437572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.437665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.437830] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.437926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.438011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.438153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.438234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.438413] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.438508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.438567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.438713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.438788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.439213] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56845eac-cd78-4268-bbf3-b5034d7128e3 is going to be updated. [ 764.468528] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.468701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.468773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.468961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.469122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.469292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56845eac-cd78-4268-bbf3-b5034d7128e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.944976] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.272986] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7ad49d7e-d890-439f-a031-a46c615a7e6a None None] Enqueued Resource ID: 56f47ae7-9d3a-4884-a47f-535733b90b1d with Priority: HIGHEST for action port [ 765.276138] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56f47ae7-9d3a-4884-a47f-535733b90b1d with Priority: HIGHEST for action port [ 765.277924] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-56f47ae7-9d3a-4884-a47f-535733b90b1d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.277924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56f47ae7-9d3a-4884-a47f-535733b90b1d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.277924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56f47ae7-9d3a-4884-a47f-535733b90b1d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.277924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56f47ae7-9d3a-4884-a47f-535733b90b1d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.277924] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f47ae7-9d3a-4884-a47f-535733b90b1d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.450527] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.450527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.450527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.450527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.450527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.450527] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be created. [ 765.476294] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.476518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.476518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.476854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.476854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.486431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: UNINITIALIZED for 2s [ 765.783024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56f47ae7-9d3a-4884-a47f-535733b90b1d [ 765.783024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.783024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.783024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.783024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.783024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.783371] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56f47ae7-9d3a-4884-a47f-535733b90b1d already deleted. [ 765.783371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56f47ae7-9d3a-4884-a47f-535733b90b1d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.274318] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 766.274643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.274860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.275869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.276297] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.276778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.276989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.277429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.277632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.277904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.278182] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.783474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.783641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.783731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.783943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.784140] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.784277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.784313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.784446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.784547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.784620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.784767] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.784862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.784924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.785080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.785222] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.785313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.785375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.785513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.785593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.785810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.785810] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.292747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d36f190-eca4-498f-b2be-5b1977c816d8: rpc.has_security_group_logging(os_id): False [ 767.310905] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.311071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.311140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.311349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.311439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.311626] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.311718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.311778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.311922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.311998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.312228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.312359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.312422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.312560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.312633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.312817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.312906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.312964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.317610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.317696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.317800] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 767.389079] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.389250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.389323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.389541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.389686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.402639] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 767.498900] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 767.499149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.499243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.499564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.499827] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.499992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.500176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.500355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.500516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.500612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.500725] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.937751] env[69255]: INFO networking_nsxv3.common.synchronization [req-311cb4bf-6981-43c4-b9b4-544e81928726 req-208d252b-621f-41f7-9b92-1c4a25d85322 tempest-ListImageFiltersTestJSON-574574432 tempest-ListImageFiltersTestJSON-574574432-project-member] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 767.937751] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 767.938327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.938327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.938327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.938545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.938733] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.938881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.938881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.939096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.939152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.939276] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.007235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.007494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.155016] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6a2f2c7-8add-480a-9bc9-a0e568fce71b req-6b2aa2d1-7877-4c68-9a36-8e4366918c63 tempest-TenantUsagesTestJSON-805327794 tempest-TenantUsagesTestJSON-805327794-project-member] Enqueued Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_members [ 768.155789] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGHEST for action security_group_members [ 768.156023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.156852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.156934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.157168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.157346] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.157438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.157511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.157660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.157755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.157873] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.298142] env[69255]: INFO networking_nsxv3.common.synchronization [None req-75bb140d-c81c-4637-a5ad-eb7f1421e888 None None] Enqueued Resource ID: b4a4d694-b06e-40dc-a745-325446f02945 with Priority: HIGHEST for action port [ 768.298142] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a4d694-b06e-40dc-a745-325446f02945 with Priority: HIGHEST for action port [ 768.298142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4a4d694-b06e-40dc-a745-325446f02945 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.298142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4a4d694-b06e-40dc-a745-325446f02945" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.299054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4a4d694-b06e-40dc-a745-325446f02945" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.299531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4a4d694-b06e-40dc-a745-325446f02945" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.299753] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a4d694-b06e-40dc-a745-325446f02945',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.442497] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.556354] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.557591] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.557591] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.557724] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.558206] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.559716] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.559716] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.559716] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.559716] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.559716] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.559716] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.559716] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.559716] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.559716] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.560106] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.560237] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.586663] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.586663] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.586663] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.586663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.586663] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-be789ee7-1430-4214-80e6-f24b6a073867 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.586663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.586663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.586663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.586663] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be789ee7-1430-4214-80e6-f24b6a073867',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.632312] env[69255]: INFO networking_nsxv3.common.synchronization [None req-dc1dfaaa-8ec9-48f6-915b-56b73cea2ed1 None None] Enqueued Resource ID: 39e52480-eea2-422d-9b32-7cbadff947cc with Priority: HIGHEST for action port [ 768.633260] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e52480-eea2-422d-9b32-7cbadff947cc with Priority: HIGHEST for action port [ 768.633703] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-39e52480-eea2-422d-9b32-7cbadff947cc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.633833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39e52480-eea2-422d-9b32-7cbadff947cc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.633924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39e52480-eea2-422d-9b32-7cbadff947cc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.634338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39e52480-eea2-422d-9b32-7cbadff947cc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.634409] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e52480-eea2-422d-9b32-7cbadff947cc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.659816] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.659816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.659986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.660132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.660208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.660386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.660486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.660812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.660812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.660812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.660812] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d is going to be updated. [ 768.707786] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.707915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.707982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.708202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.708355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.718397] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d in Status: IN_PROGRESS for 2s [ 768.807411] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4a4d694-b06e-40dc-a745-325446f02945 [ 768.807659] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.807798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.807868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.808105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.808202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.808298] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4a4d694-b06e-40dc-a745-325446f02945 already deleted. [ 768.808379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4a4d694-b06e-40dc-a745-325446f02945" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.944152] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.093555] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.093555] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.093555] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.097022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.097022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.097022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port be789ee7-1430-4214-80e6-f24b6a073867 not found, creating... [ 769.097022] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.097022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.097022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.097672] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.097927] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.098521] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.098840] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.099084] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.099415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.099825] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.100107] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: be789ee7-1430-4214-80e6-f24b6a073867 is going to be created. [ 769.123378] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.123604] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.123702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.123977] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.124227] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.124485] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.141920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39e52480-eea2-422d-9b32-7cbadff947cc [ 769.142181] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.142336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.142418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.142637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.142727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.142817] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39e52480-eea2-422d-9b32-7cbadff947cc already deleted. [ 769.142896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39e52480-eea2-422d-9b32-7cbadff947cc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.433392] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 769.433643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.446432] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.446716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.446822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.447091] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.447659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.447806] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be updated. [ 769.480308] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.480308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.480505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.480600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.480773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.490152] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 770.063450] env[69255]: INFO networking_nsxv3.common.synchronization [req-4065ecf4-1bc7-4fbe-a9e6-8145453ad6de req-b5532ebc-7d62-4f26-b7bc-cdbc48c3c72c tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 770.068283] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 770.068498] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.068702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.068812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.069048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.069219] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.069317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.069377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.069527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.069614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.069736] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.385085] env[69255]: INFO networking_nsxv3.common.synchronization [req-311cb4bf-6981-43c4-b9b4-544e81928726 req-a410a2c3-a342-4670-a290-6d5de71823a7 service nova] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_rules [ 770.385085] env[69255]: INFO networking_nsxv3.common.synchronization [req-311cb4bf-6981-43c4-b9b4-544e81928726 req-a410a2c3-a342-4670-a290-6d5de71823a7 service nova] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 770.385085] env[69255]: INFO networking_nsxv3.common.synchronization [req-311cb4bf-6981-43c4-b9b4-544e81928726 req-a410a2c3-a342-4670-a290-6d5de71823a7 service nova] Enqueued Resource ID: be789ee7-1430-4214-80e6-f24b6a073867 with Priority: HIGHEST for action port [ 770.386607] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_rules [ 770.386607] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 770.386846] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be789ee7-1430-4214-80e6-f24b6a073867 with Priority: HIGHEST for action port [ 770.389191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.389191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.389191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.389191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.389191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-be789ee7-1430-4214-80e6-f24b6a073867 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.389191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.389191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.389191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.389191] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be789ee7-1430-4214-80e6-f24b6a073867',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.409622] env[69255]: INFO networking_nsxv3.common.synchronization [None req-864c2456-b75a-4467-853b-417ace8902b3 tempest-ServersTestFqdnHostnames-596836303 tempest-ServersTestFqdnHostnames-596836303-project-member] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_rules [ 770.410613] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_rules [ 770.410953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.410953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.411228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.411761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.412337] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.577886] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.577886] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.577886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.577886] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 770.603545] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.603787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.603919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.604193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.604335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.616798] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 770.649875] env[69255]: INFO networking_nsxv3.common.synchronization [None req-942a5479-4cdc-4cd8-b767-e03d21a00b9e tempest-ServersTestFqdnHostnames-596836303 tempest-ServersTestFqdnHostnames-596836303-project-member] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_rules [ 770.650443] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_rules [ 770.650814] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.651092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.731384] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d in Status: SUCCESS [ 770.731563] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d deletion is rescheduled due to dependency. [ 770.731679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.735794] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.735981] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.736120] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.736421] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.736750] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.736919] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.737995] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.738351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.738518] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.738734] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.738841] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.738947] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.739064] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.739173] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.739276] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.739404] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.760971] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.761185] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.762693] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.762693] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.762693] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-35005920-f0f9-4df0-8e18-21714a4f83c2 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.762693] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.762693] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.762693] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.763371] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35005920-f0f9-4df0-8e18-21714a4f83c2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.776158] env[69255]: INFO networking_nsxv3.common.synchronization [None req-bb135893-5abb-45d1-adcb-0fcaa4a7ca9c None None] Enqueued Resource ID: e8e7e31f-b85b-4375-a993-a3d39c4049e3 with Priority: HIGHEST for action port [ 770.776874] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8e7e31f-b85b-4375-a993-a3d39c4049e3 with Priority: HIGHEST for action port [ 770.777451] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8e7e31f-b85b-4375-a993-a3d39c4049e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.778125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8e7e31f-b85b-4375-a993-a3d39c4049e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.778733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8e7e31f-b85b-4375-a993-a3d39c4049e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.778733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8e7e31f-b85b-4375-a993-a3d39c4049e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.778733] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e7e31f-b85b-4375-a993-a3d39c4049e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.891423] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be789ee7-1430-4214-80e6-f24b6a073867 with status ACTIVE [ 770.892677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.892677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.892677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.892974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.892974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.893127] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.893212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.893391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.893439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.894557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.894557] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.894557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.894557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.894557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.894557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.894557] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be789ee7-1430-4214-80e6-f24b6a073867 is going to be updated. [ 770.918744] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.918947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.919023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.919290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.919493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.922998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be789ee7-1430-4214-80e6-f24b6a073867" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.939748] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.941017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 already deleted. [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.941017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.941017] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.265391] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.265687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.265772] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.266507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.266507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.266507] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 35005920-f0f9-4df0-8e18-21714a4f83c2 not found, creating... [ 771.266693] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.266807] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.266898] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.267147] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.267296] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.270546] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.270546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.270546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.270546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.270546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.270546] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 35005920-f0f9-4df0-8e18-21714a4f83c2 is going to be created. [ 771.280590] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8e7e31f-b85b-4375-a993-a3d39c4049e3 [ 771.280813] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.280945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.281023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.281241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.281334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.281424] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8e7e31f-b85b-4375-a993-a3d39c4049e3 already deleted. [ 771.281502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8e7e31f-b85b-4375-a993-a3d39c4049e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.292111] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.292332] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.292464] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.292974] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.292974] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.293199] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.457906] env[69255]: INFO networking_nsxv3.common.synchronization [None req-c266d9d7-ca80-47cd-bc0f-0711cd710f6c None None] Enqueued Resource ID: 85c608b1-69f2-415d-8beb-fe171596b900 with Priority: HIGHEST for action port [ 771.457906] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c608b1-69f2-415d-8beb-fe171596b900 with Priority: HIGHEST for action port [ 771.458011] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c608b1-69f2-415d-8beb-fe171596b900 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.458148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c608b1-69f2-415d-8beb-fe171596b900" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.458216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c608b1-69f2-415d-8beb-fe171596b900" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.458465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c608b1-69f2-415d-8beb-fe171596b900" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.458550] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c608b1-69f2-415d-8beb-fe171596b900',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.462517] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.462670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.463235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.463235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.463666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.463666] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 already deleted. [ 771.463666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.500551] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 771.501152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.502237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.502515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.502749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.502904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.503148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.503215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.503398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.503519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.503706] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.503797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.503863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.504018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.504189] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.504300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.504363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.504510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.504653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.504988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.505085] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.509782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.509782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.509782] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.509782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.509782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.509782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.509782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.509782] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.962057] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85c608b1-69f2-415d-8beb-fe171596b900 [ 771.962057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.962057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.962057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.962057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.962057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.962057] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85c608b1-69f2-415d-8beb-fe171596b900 already deleted. [ 771.962057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c608b1-69f2-415d-8beb-fe171596b900" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.010546] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a73172-9297-4dba-844d-93ad67b908a4: rpc.has_security_group_logging(os_id): False [ 772.012747] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.031022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.031022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.031022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.031022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.031664] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.031664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.031664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.031664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.031664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.031664] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be created. [ 772.096024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.096024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.096024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.096024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.096024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.113742] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 772.219086] env[69255]: INFO networking_nsxv3.common.synchronization [req-4065ecf4-1bc7-4fbe-a9e6-8145453ad6de req-fa34a9f4-4602-4a6d-aeeb-fb2bc7f4d92b service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 772.219086] env[69255]: INFO networking_nsxv3.common.synchronization [req-4065ecf4-1bc7-4fbe-a9e6-8145453ad6de req-fa34a9f4-4602-4a6d-aeeb-fb2bc7f4d92b service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 772.219086] env[69255]: INFO networking_nsxv3.common.synchronization [req-4065ecf4-1bc7-4fbe-a9e6-8145453ad6de req-fa34a9f4-4602-4a6d-aeeb-fb2bc7f4d92b service nova] Enqueued Resource ID: 35005920-f0f9-4df0-8e18-21714a4f83c2 with Priority: HIGHEST for action port [ 772.222108] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 772.222108] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 772.222108] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35005920-f0f9-4df0-8e18-21714a4f83c2 with Priority: HIGHEST for action port [ 772.222266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.222266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.222347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.222545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.222631] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.223784] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.223784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.224101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-35005920-f0f9-4df0-8e18-21714a4f83c2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.224101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.224199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.224280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.224364] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35005920-f0f9-4df0-8e18-21714a4f83c2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.514626] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.644671] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 772.644875] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 772.645149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.645395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.645662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.645937] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.646760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.646760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.646967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.647213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.647342] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.730028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35005920-f0f9-4df0-8e18-21714a4f83c2 with status ACTIVE [ 772.730028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.730028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.730028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.730028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.730929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.730929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.730929] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35005920-f0f9-4df0-8e18-21714a4f83c2 is going to be updated. [ 772.758972] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.760024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.760907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.760907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.760907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.760907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35005920-f0f9-4df0-8e18-21714a4f83c2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.951039] env[69255]: INFO networking_nsxv3.common.synchronization [req-ea688e16-8dd9-4151-a1c1-640155aac326 req-bd653696-abf7-4b84-b62f-9df4bfb8104b tempest-InstanceActionsNegativeTestJSON-2056299819 tempest-InstanceActionsNegativeTestJSON-2056299819-project-member] Enqueued Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_members [ 772.952938] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_members [ 772.953385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.953568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.953625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.953919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.954054] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.954307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.954810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.954810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.954810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.954810] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.017572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.017572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.018191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.018704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.018880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.019059] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be updated. [ 773.053981] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.054132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.054132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.054316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.054513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.065805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 773.151936] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.457367] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.457607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.457755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.458012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.458150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.458385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.458526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.458618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.458809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.458923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.459149] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad already deleted. [ 773.459149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.654875] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.683467] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.683675] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-868" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.683813] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-868" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.684550] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-868" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.684868] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.685086] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.685248] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.685759] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.685975] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.686266] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.686701] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.687063] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.687721] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.687721] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.687721] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.687721] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.710967] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.710967] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.710967] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.710967] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-868" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.711128] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-0b6530f3-d91a-4721-8287-362a06a9be72 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.711197] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.711329] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.711616] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.711755] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6530f3-d91a-4721-8287-362a06a9be72',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.036946] env[69255]: INFO networking_nsxv3.common.synchronization [None req-8c4d3df8-904f-4344-a6cb-9ecbb8b4c21e None None] Enqueued Resource ID: 773ebf46-c3df-4100-872b-2db64f277ca2 with Priority: HIGHEST for action port [ 774.037687] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 773ebf46-c3df-4100-872b-2db64f277ca2 with Priority: HIGHEST for action port [ 774.038403] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-773ebf46-c3df-4100-872b-2db64f277ca2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.038698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-773ebf46-c3df-4100-872b-2db64f277ca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.038698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-773ebf46-c3df-4100-872b-2db64f277ca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.038828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-773ebf46-c3df-4100-872b-2db64f277ca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.038871] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('773ebf46-c3df-4100-872b-2db64f277ca2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.126401] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 774.127305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.127430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.127637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.127743] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.158259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.158259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.158259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.158259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.158259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.158469] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 774.189965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.190133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.190206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.190422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.190574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.200641] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 774.214342] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.214675] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.214675] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.215119] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.215119] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.215607] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 0b6530f3-d91a-4721-8287-362a06a9be72 not found, creating... [ 774.215907] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.216195] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.216361] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.216705] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.216862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.217209] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.217402] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.217669] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.217795] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.217941] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.218101] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 0b6530f3-d91a-4721-8287-362a06a9be72 is going to be created. [ 774.243836] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.244348] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.244570] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.244898] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.245227] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.245784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.329613] env[69255]: INFO networking_nsxv3.common.synchronization [None req-00bc4a71-3260-49cc-9da2-a7b29fd0eb95 None None] Enqueued Resource ID: 6346eaca-d7eb-4e70-bd74-bb448b2c67ac with Priority: HIGHEST for action port [ 774.330271] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6346eaca-d7eb-4e70-bd74-bb448b2c67ac with Priority: HIGHEST for action port [ 774.330584] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6346eaca-d7eb-4e70-bd74-bb448b2c67ac taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.330709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6346eaca-d7eb-4e70-bd74-bb448b2c67ac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.330775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6346eaca-d7eb-4e70-bd74-bb448b2c67ac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.334198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6346eaca-d7eb-4e70-bd74-bb448b2c67ac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.334367] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6346eaca-d7eb-4e70-bd74-bb448b2c67ac',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.542945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 773ebf46-c3df-4100-872b-2db64f277ca2 [ 774.543742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.543742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.543742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.544615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.544615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.544615] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:773ebf46-c3df-4100-872b-2db64f277ca2 already deleted. [ 774.544615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-773ebf46-c3df-4100-872b-2db64f277ca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.635023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.635023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.838252] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6346eaca-d7eb-4e70-bd74-bb448b2c67ac [ 774.838539] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.838647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.838990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.839138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.839257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.839421] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6346eaca-d7eb-4e70-bd74-bb448b2c67ac already deleted. [ 774.839524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6346eaca-d7eb-4e70-bd74-bb448b2c67ac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.077262] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 775.077552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.077675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.077939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.078085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.078203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.078270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.078419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.078504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.078677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.080604] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.241731] env[69255]: INFO networking_nsxv3.common.synchronization [req-ea688e16-8dd9-4151-a1c1-640155aac326 req-222f34a8-15b3-4c3e-8b66-606ceae3613d service nova] Enqueued Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_rules [ 775.241970] env[69255]: INFO networking_nsxv3.common.synchronization [req-ea688e16-8dd9-4151-a1c1-640155aac326 req-222f34a8-15b3-4c3e-8b66-606ceae3613d service nova] Enqueued Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_members [ 775.242059] env[69255]: INFO networking_nsxv3.common.synchronization [req-ea688e16-8dd9-4151-a1c1-640155aac326 req-222f34a8-15b3-4c3e-8b66-606ceae3613d service nova] Enqueued Resource ID: 0b6530f3-d91a-4721-8287-362a06a9be72 with Priority: HIGHEST for action port [ 775.242240] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_rules [ 775.242367] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_members [ 775.242465] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6530f3-d91a-4721-8287-362a06a9be72 with Priority: HIGHEST for action port [ 775.243486] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.243621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.243694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.243927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.244026] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.245034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.245034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.245034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.245211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.245347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.245440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.245501] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.245637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.245720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.245834] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.246730] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b6530f3-d91a-4721-8287-362a06a9be72 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.246978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.246978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.247057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.247110] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6530f3-d91a-4721-8287-362a06a9be72',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.375244] env[69255]: INFO networking_nsxv3.common.synchronization [None req-1307e69c-ad0c-4268-bd27-1213af524388 tempest-ServersV294TestFqdnHostnames-1174110639 tempest-ServersV294TestFqdnHostnames-1174110639-project-member] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_rules [ 775.380033] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_rules [ 775.380033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.380033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.380033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.380033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.380033] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.474896] env[69255]: INFO networking_nsxv3.common.synchronization [req-9df18719-82cf-4cc7-96db-9ddcc2db9de0 req-ecf20a04-793c-4416-b682-f35a47d88706 tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 775.475865] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 775.475865] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.476035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.476035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.483803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.483803] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.483803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.483803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.483803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.483803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.483803] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.585695] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.585834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.585834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.586130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.586235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.586425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.586480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.586644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.586788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.586839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.587083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.587151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.587253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.587440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.587609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.587946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.587946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.587946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.588117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.588117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.588205] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.607524] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f54d0cb4-6ec2-4535-b87c-537d31697417 tempest-ServersV294TestFqdnHostnames-1174110639 tempest-ServersV294TestFqdnHostnames-1174110639-project-member] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_rules [ 775.609129] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_rules [ 775.609562] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.609712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.641305] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 775.642050] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:1 started [ 775.750470] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.751452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.751558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.751933] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b6530f3-d91a-4721-8287-362a06a9be72 with status ACTIVE [ 775.752106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.752212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.752282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.752512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.752601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.752766] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.752860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.752921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.753088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.753168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.753354] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.753525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.753525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.753885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.753885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.753885] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b6530f3-d91a-4721-8287-362a06a9be72 is going to be updated. [ 775.778248] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.778248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.778248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.778248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.778248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.778248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b6530f3-d91a-4721-8287-362a06a9be72" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.899077] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.899077] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.899077] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.901179] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.901179] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.904804] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.904804] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.904804] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.904804] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.904804] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.904804] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.904804] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.904804] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.904804] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.904804] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.904804] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.908288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.908288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.908288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.908996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.908996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.908996] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 already deleted. [ 775.908996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.914669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.914669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.914669] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.940443] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.940654] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.941924] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.941924] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.941924] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.941924] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.942217] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.942483] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.942592] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9ee650-63eb-42ba-8f9c-a7f1a119c7a7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.985330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.985482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.985554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.985773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.985869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.986103] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.986262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.986375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.986686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.986955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.987092] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b already deleted. [ 775.987141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.032595] env[69255]: INFO networking_nsxv3.common.synchronization [None req-06bdaf36-eb6f-47cd-baf4-5592fd39b071 None None] Enqueued Resource ID: e5f021d2-6b65-4119-ba58-294d8404871e with Priority: HIGHEST for action port [ 776.034094] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f021d2-6b65-4119-ba58-294d8404871e with Priority: HIGHEST for action port [ 776.034094] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5f021d2-6b65-4119-ba58-294d8404871e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.034094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5f021d2-6b65-4119-ba58-294d8404871e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.034094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5f021d2-6b65-4119-ba58-294d8404871e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.034094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5f021d2-6b65-4119-ba58-294d8404871e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.034094] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5f021d2-6b65-4119-ba58-294d8404871e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.090942] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a73172-9297-4dba-844d-93ad67b908a4: rpc.has_security_group_logging(os_id): False [ 776.110310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.110480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.110549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.110770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.110870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.111111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.111213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.111277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.111432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.111513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.111693] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.111786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.111848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.111985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.112073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.112268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.112361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.112423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.112563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.112655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.112759] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be updated. [ 776.189531] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.189703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.189747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.189952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.190111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.204815] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 776.222106] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 776.222322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.222493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.222841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.223135] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.223257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.223257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.223424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.224938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.224938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.224938] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.252746] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.435651] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.435830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.435913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.436198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.436321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.436510] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 already deleted. [ 776.436620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.447152] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.447152] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.447439] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.449973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.449973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.449973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 not found, creating... [ 776.449973] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.449973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.449973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.449973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.449973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.450937] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.451337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.451628] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.452070] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.452379] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.452689] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 is going to be created. [ 776.478202] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.478202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.478202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.478202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.478202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.478202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.538383] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5f021d2-6b65-4119-ba58-294d8404871e [ 776.538383] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.538383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.538383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.538383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.538383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.538383] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5f021d2-6b65-4119-ba58-294d8404871e already deleted. [ 776.538383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5f021d2-6b65-4119-ba58-294d8404871e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.729319] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.729579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.729690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.730032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.730271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.730377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.730444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.730608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.730700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.730790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.730934] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.731041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.731105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.731249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.732161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.732161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.732161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.732161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.732161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.732161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.732161] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.755552] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.755552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.755552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.755552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.755552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.755552] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad is going to be created. [ 776.785982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.785982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.785982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.785982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.785982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.798656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad in Status: UNINITIALIZED for 2s [ 777.178041] env[69255]: INFO networking_nsxv3.common.synchronization [req-9df18719-82cf-4cc7-96db-9ddcc2db9de0 req-89454751-bd66-46dc-91ed-4bd5e7adc092 service nova] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 777.179448] env[69255]: INFO networking_nsxv3.common.synchronization [req-9df18719-82cf-4cc7-96db-9ddcc2db9de0 req-89454751-bd66-46dc-91ed-4bd5e7adc092 service nova] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 777.179765] env[69255]: INFO networking_nsxv3.common.synchronization [req-9df18719-82cf-4cc7-96db-9ddcc2db9de0 req-89454751-bd66-46dc-91ed-4bd5e7adc092 service nova] Enqueued Resource ID: db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 with Priority: HIGHEST for action port [ 777.180417] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 777.180632] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 777.180791] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 with Priority: HIGHEST for action port [ 777.181515] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.181812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.181889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.182200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.182326] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.183504] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.183670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.183783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.183968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.184164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.184284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.184383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.184563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.184648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.184745] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.185858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.186613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.186613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.186613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.186613] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9ee650-63eb-42ba-8f9c-a7f1a119c7a7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.233581] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3: rpc.has_security_group_logging(os_id): False [ 777.261266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.261455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.261546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.261843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.262045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.262315] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.262432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.262498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.262699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.262810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.263049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.263150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.263251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.263373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.263543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.263740] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.263836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.263899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.264053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.264135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.264224] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 777.339986] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.340248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.340333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.340559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.340722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.360191] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 777.688435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.688435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.694154] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.694154] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 with status ACTIVE [ 777.694154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.694154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.694154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.694154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.694752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.694752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.694752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.694752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.694880] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db9ee650-63eb-42ba-8f9c-a7f1a119c7a7 is going to be updated. [ 777.717757] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.717929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.718035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.718250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.718410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.718595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9ee650-63eb-42ba-8f9c-a7f1a119c7a7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.080319] env[69255]: INFO networking_nsxv3.common.synchronization [req-bfc72fd2-8f8f-4c0d-bd07-194813d30310 req-47714edb-9563-49ce-bef0-81944c7836ed tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 778.080319] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 778.080319] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.080681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.081015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.081389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.081779] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.082103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.082325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.082652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.082854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.083045] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.198228] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.239592] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 778.239592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.437554] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.437765] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.437975] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.438291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.438638] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.439586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.439586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.439586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.439586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.439586] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.439586] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.439799] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.439799] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.439855] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.439954] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.440103] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.460076] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.460304] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 778.460451] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.460636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.460954] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c4ffd75a-43b2-47f2-aee7-7c373d966483 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.461150] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.461272] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.461603] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.461747] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4ffd75a-43b2-47f2-aee7-7c373d966483',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.586057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.586236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.586236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.586459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.586611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.586831] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.586938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.587008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.587211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.587300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.587388] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be updated. [ 778.615476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.615689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.615743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.615975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.616157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.626556] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 778.700374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.700530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.700530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.700789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.700907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.701059] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be created. [ 778.730087] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.730087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.730087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.730396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.730800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.743437] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: UNINITIALIZED for 2s [ 778.809066] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad in Status: SUCCESS [ 778.809216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.809352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.809566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.809766] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.809888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.809953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.810151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.810241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.810326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.810416] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.964252] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.964625] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.965061] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.965227] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.965392] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.966733] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c4ffd75a-43b2-47f2-aee7-7c373d966483 not found, creating... [ 778.966733] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.966733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.966733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.966733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.966733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.967094] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.967407] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.967407] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.967624] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.967766] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.968089] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c4ffd75a-43b2-47f2-aee7-7c373d966483 is going to be created. [ 778.992563] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.992861] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.992980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.993321] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.993606] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.993921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.313101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.313101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.313101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.313101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.313101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.313101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.313101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.313799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.313799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.313799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.313799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.313799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.313799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.314035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.314035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.314109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.314155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.314293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.314366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.314452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.314543] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.371543] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 779.371789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.754117] env[69255]: INFO networking_nsxv3.common.synchronization [req-bfc72fd2-8f8f-4c0d-bd07-194813d30310 req-58659fa7-9e14-44fb-9fcc-52876ada26cb service nova] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_rules [ 779.754305] env[69255]: INFO networking_nsxv3.common.synchronization [req-bfc72fd2-8f8f-4c0d-bd07-194813d30310 req-58659fa7-9e14-44fb-9fcc-52876ada26cb service nova] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 779.754457] env[69255]: INFO networking_nsxv3.common.synchronization [req-bfc72fd2-8f8f-4c0d-bd07-194813d30310 req-58659fa7-9e14-44fb-9fcc-52876ada26cb service nova] Enqueued Resource ID: c4ffd75a-43b2-47f2-aee7-7c373d966483 with Priority: HIGHEST for action port [ 779.754820] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_rules [ 779.754952] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 779.755079] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4ffd75a-43b2-47f2-aee7-7c373d966483 with Priority: HIGHEST for action port [ 779.757388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.757388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.757388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.757388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.757388] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.757388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.757388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.757646] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4ffd75a-43b2-47f2-aee7-7c373d966483 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.757694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.757754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.757935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.758022] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4ffd75a-43b2-47f2-aee7-7c373d966483',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.816985] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81a64265-25ba-4ac7-84e1-066ecf8cecad: rpc.has_security_group_logging(os_id): False [ 779.834711] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.834855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.834924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.835149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.835245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.835425] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.835523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.835586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.835732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.835810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.836009] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.836116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.836179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.836316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.836449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.836784] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.836898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.836980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.837147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.837226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.837325] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad is going to be created. [ 779.897913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.898201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.898341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.898653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.898937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.912350] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad in Status: IN_PROGRESS for 2s [ 780.265030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.265030] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4ffd75a-43b2-47f2-aee7-7c373d966483 with status ACTIVE [ 780.265030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.265030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.265030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.265030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.265763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.265763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.265763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.265763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.265763] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4ffd75a-43b2-47f2-aee7-7c373d966483 is going to be updated. [ 780.289927] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.290828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.291051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.291420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.291694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.294529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4ffd75a-43b2-47f2-aee7-7c373d966483" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.637982] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 780.637982] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 deletion is rescheduled due to dependency. [ 780.637982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.637982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.637982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.638648] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.638920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.639107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.639348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.640018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.640018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.757096] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 780.757096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.757353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.759885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.759885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.759885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.759885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.759885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.760575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.760575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.760575] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.144242] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.265971] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.647675] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.770982] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97be36bb-9aa7-4ca4-9b9b-f2f13467259b: rpc.has_security_group_logging(os_id): False [ 781.796045] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.796045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.796045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.796045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.796045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.796045] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.796045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.796045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.796504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.796504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.796504] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be created. [ 781.867512] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.867681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.867848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.867969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.868172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.882133] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 781.934568] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad in Status: SUCCESS [ 781.934966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.151534] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.151534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.151534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.151534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.151792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.151792] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be updated. [ 782.190606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.190606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.190606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.190606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.190606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.202563] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 782.788072] env[69255]: INFO networking_nsxv3.common.synchronization [req-67d56452-f3ad-47c3-83b5-25b87e6d9272 req-5d93267b-6220-439b-8cbc-af850088f2e2 tempest-ListServerFiltersTestJSON-530012782 tempest-ListServerFiltersTestJSON-530012782-project-member] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 782.788668] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 782.788838] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.790416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.790509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.790659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.790836] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.790938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.791008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.791170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.791260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.791354] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.293434] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.795451] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.897243] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 783.897406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.214300] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 784.214544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.215023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.215070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.215244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.215365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.215448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.215594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.215679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.215769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.215866] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.298044] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.298044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.298044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.298044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.298429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.298429] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 784.330158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.330288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.330332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.331030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.331030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.341021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 784.719050] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.719050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.719050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.719050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.719050] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.719050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.719050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.719050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.719426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.719517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.719709] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.719852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.719951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.720145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.720337] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.720486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.720584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.720758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.720879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.721312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.721312] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.225120] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39f23576-868c-480d-b556-0aad9680f300: rpc.has_security_group_logging(os_id): False [ 785.246395] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.246558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.247312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.247312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.247312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.247312] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.247671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.247671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.247671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.247772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.250347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.250347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.250347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.250347] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be updated. [ 785.350254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.350254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.350254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.350254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.350254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.365945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 786.352442] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 786.352442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 787.380431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.791012] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 787.791012] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 788.787213] env[69255]: INFO networking_nsxv3.common.synchronization [req-34e1c2eb-d8e9-4f07-ac3f-815518794132 req-aa6ed041-9255-4247-b468-4c9d40a8e743 tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_members [ 788.787828] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_members [ 788.789271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.792202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.792202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.792202] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.293409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.293638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.293727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.293987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.294192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.294854] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.294854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.294854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.294854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.295169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.295169] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 already deleted. [ 789.295169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.362637] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-659 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.362822] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.362870] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.363592] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.363592] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.363592] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.365109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.365109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.365109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.365109] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.365109] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.365109] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.365109] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.365109] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.365429] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.365429] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.387815] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.388030] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.388194] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.388463] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-659" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.388912] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-53135062-16f7-45d6-87fa-0fee6e11c167 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.389174] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.389384] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.389619] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.389791] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53135062-16f7-45d6-87fa-0fee6e11c167',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.895027] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.895027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 53135062-16f7-45d6-87fa-0fee6e11c167 not found, creating... [ 789.895027] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.895027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.895726] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.895726] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.896791] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.899833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.899833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.899833] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 53135062-16f7-45d6-87fa-0fee6e11c167 is going to be created. [ 789.921566] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.922240] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.922240] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.922240] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.922463] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.922717] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.056819] env[69255]: INFO networking_nsxv3.common.synchronization [req-6d5c45b0-28e9-4aef-81a0-78cafd22ecc5 req-92b84266-b7b9-4b2a-abc7-c6699c95a373 tempest-InstanceActionsNegativeTestJSON-2056299819 tempest-InstanceActionsNegativeTestJSON-2056299819-project-member] Enqueued Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_members [ 790.057698] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGHEST for action security_group_members [ 790.058033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.058188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.058255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.058471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.058802] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.058802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.058802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.059034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.059034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.059111] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.566073] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.566247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.566247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.566585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.567139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.567139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.567139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.567139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.567737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.567737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.567737] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad is going to be updated. [ 790.603327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.603327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.603582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.603582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.603819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.613886] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad in Status: IN_PROGRESS for 2s [ 790.722252] env[69255]: INFO networking_nsxv3.common.synchronization [req-34e1c2eb-d8e9-4f07-ac3f-815518794132 req-4d2eb6cf-da35-4a78-a8e2-fdc105bede60 service nova] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_rules [ 790.722252] env[69255]: INFO networking_nsxv3.common.synchronization [req-34e1c2eb-d8e9-4f07-ac3f-815518794132 req-4d2eb6cf-da35-4a78-a8e2-fdc105bede60 service nova] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_members [ 790.722252] env[69255]: INFO networking_nsxv3.common.synchronization [req-34e1c2eb-d8e9-4f07-ac3f-815518794132 req-4d2eb6cf-da35-4a78-a8e2-fdc105bede60 service nova] Enqueued Resource ID: 53135062-16f7-45d6-87fa-0fee6e11c167 with Priority: HIGHEST for action port [ 790.722252] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_rules [ 790.722252] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_members [ 790.722252] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53135062-16f7-45d6-87fa-0fee6e11c167 with Priority: HIGHEST for action port [ 790.722252] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.722252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.722252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.722252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.722252] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.723065] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.723065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.723192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.724047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.724047] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.724047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.724047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.724047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.724047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.724047] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.724669] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-53135062-16f7-45d6-87fa-0fee6e11c167 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.724797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.727489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.727489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.727489] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53135062-16f7-45d6-87fa-0fee6e11c167',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.226849] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.227252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.227309] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.229820] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53135062-16f7-45d6-87fa-0fee6e11c167 with status ACTIVE [ 791.230028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.230148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.230208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.230419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.230510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.230686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.230783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.230880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.230992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.231081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.231286] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.231495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.231495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.231593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.231647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.231732] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53135062-16f7-45d6-87fa-0fee6e11c167 is going to be updated. [ 791.273042] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.273185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.273319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.273589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.273775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.274019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53135062-16f7-45d6-87fa-0fee6e11c167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.730125] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.232817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.233142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.233142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.233273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.233365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.233463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 is going to be created. [ 792.262210] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.262210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.262210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.262210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.262408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.273214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 in Status: UNINITIALIZED for 2s [ 792.625257] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad in Status: SUCCESS [ 792.625864] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad deletion is rescheduled due to dependency. [ 792.626996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.923358] env[69255]: INFO networking_nsxv3.common.synchronization [req-2ad6a702-f513-495e-b559-8024ea3ae85d req-16b4f7d6-f05a-41b5-ac1f-813159a190f2 tempest-ServersTestJSON-447164745 tempest-ServersTestJSON-447164745-project-member] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_members [ 792.923993] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGHEST for action security_group_members [ 792.924356] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.924559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.924684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.925011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.925243] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.925354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.925421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.925599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.925701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.925815] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.429682] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.430080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.430080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.432012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.432012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.432012] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.432012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.432012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.432012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.432012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.432012] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 is going to be updated. [ 793.473517] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.473698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.473698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.473985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.474086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.485373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 in Status: IN_PROGRESS for 2s [ 794.259289] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-3e950e9c-2c81-40dd-b1c0-2f0acc2545f6 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 794.260044] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 794.260355] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.260486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.260545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.260751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.260907] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.261020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.261155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.261308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.262203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.262203] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.285195] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 in Status: SUCCESS [ 794.285521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.285935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.286205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.286360] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.286657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.287197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.287197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.287197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.287197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.287559] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.564141] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-0a0cbaa7-e827-4729-a625-e9794696480f tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 794.565248] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 794.565756] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.565997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.767471] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.767687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.767766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.768043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.768192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.768447] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.768594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.768664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.768844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.768927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.769052] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 794.790153] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.799880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.800177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.800282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.800525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.800764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.811819] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 794.909303] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.909547] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-376" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.909668] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-376" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.910366] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-376" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.910508] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.910793] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.910991] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.911334] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.911573] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.911930] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.912119] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.912301] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.912522] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.912698] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.912888] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.913150] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.933656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.933907] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.934110] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.934376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-376" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.934792] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c69b14ec-b340-4734-8e33-cc945609e98d taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.934980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.935168] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.935501] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.935653] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69b14ec-b340-4734-8e33-cc945609e98d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.292520] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3c78b55-33cd-47e8-95aa-4dc1be978038: rpc.has_security_group_logging(os_id): False [ 795.313345] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.314036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.314036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.314036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.314036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.314296] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.314296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.314296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.314452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.314452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.314534] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 is going to be created. [ 795.379598] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.379796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.379901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.380231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.380491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.393249] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 in Status: IN_PROGRESS for 2s [ 795.438747] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.438992] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.439133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.439455] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.439680] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.439880] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c69b14ec-b340-4734-8e33-cc945609e98d not found, creating... [ 795.440226] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.440403] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.440523] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.440769] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.440904] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.441319] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.441517] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.441599] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.441809] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.441946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.442099] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c69b14ec-b340-4734-8e33-cc945609e98d is going to be created. [ 795.469276] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.470222] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.470222] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.470222] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.470222] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.470379] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.496245] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 in Status: SUCCESS [ 795.496431] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 deletion is rescheduled due to dependency. [ 795.496552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.162311] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-a2d60e33-cc97-496e-8e5b-d140c224cb4a service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 796.162603] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-a2d60e33-cc97-496e-8e5b-d140c224cb4a service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 796.162759] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-a2d60e33-cc97-496e-8e5b-d140c224cb4a service nova] Enqueued Resource ID: c69b14ec-b340-4734-8e33-cc945609e98d with Priority: HIGHEST for action port [ 796.163505] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 796.163709] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 796.163851] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69b14ec-b340-4734-8e33-cc945609e98d with Priority: HIGHEST for action port [ 796.164262] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.164412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.164512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.164789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.164908] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.165983] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.166121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.166281] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69b14ec-b340-4734-8e33-cc945609e98d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.166408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.166466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.166716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.166803] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69b14ec-b340-4734-8e33-cc945609e98d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.669395] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.669623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.669804] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c69b14ec-b340-4734-8e33-cc945609e98d with status ACTIVE [ 796.670017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.670173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.670262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.670534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.670633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.670809] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.670939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.671046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.671237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.671352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.671571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.671674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.671735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.671882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.671950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.672053] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c69b14ec-b340-4734-8e33-cc945609e98d is going to be updated. [ 796.695945] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.696171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.696211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.697046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.697046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.697046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69b14ec-b340-4734-8e33-cc945609e98d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.823587] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 796.823793] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b deletion is rescheduled due to dependency. [ 796.823930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.824127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.824371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.824810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.824948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.824948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.825123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.825211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.825313] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.961628] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.961628] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-882" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.961628] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-882" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.961628] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-882" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.962065] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.962414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.962414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.962626] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.962811] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.963042] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.963162] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.963272] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.963381] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.963549] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.963643] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.963821] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.983253] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.983482] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.983665] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.983899] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-882" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.984316] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.984539] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.984682] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.985110] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.985321] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.328121] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.413878] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 in Status: SUCCESS [ 797.414128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.488355] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.488546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.489053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.489053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.489213] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.489299] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 not found, creating... [ 797.489555] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.489788] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.489860] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.490070] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.490211] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.490498] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.490661] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.490782] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.490993] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.491312] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.491473] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 is going to be created. [ 797.525354] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.525946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.525946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.526196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.526378] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.527514] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.830504] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.335940] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.335940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.335940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.335940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.336334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.336857] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 798.356963] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-745c3342-27ef-455c-8e25-c6809cba32cd service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 798.357252] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-745c3342-27ef-455c-8e25-c6809cba32cd service nova] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 798.358240] env[69255]: INFO networking_nsxv3.common.synchronization [req-d5f1ff94-1d9f-4152-bde6-816adfd3a4a1 req-745c3342-27ef-455c-8e25-c6809cba32cd service nova] Enqueued Resource ID: e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 with Priority: HIGHEST for action port [ 798.359282] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_rules [ 798.359458] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 798.359615] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 with Priority: HIGHEST for action port [ 798.361480] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.361616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.361974] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.361974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.362552] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.362552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.362552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.362552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.362750] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.371156] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.375415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.375604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.375927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.376241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.388028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 798.865512] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 with status ACTIVE [ 798.867916] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.868171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.868295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.868534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.868651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.868908] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.869067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.869156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.869343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.869486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.869632] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.869804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.869896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.870061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.870137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.870227] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6 is going to be updated. [ 798.906023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.906023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.906023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.906023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.906023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.906023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b2eff8-2bf1-463e-8e93-91cf80ea1bd6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.405581] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 800.405581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.405581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.406176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.406176] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.409963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.412046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.412348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.413030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.413030] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.817325] env[69255]: INFO networking_nsxv3.common.synchronization [req-2ac4ddc4-4e10-4795-960e-6745fbac6ba5 req-fbb4d6c4-32f5-4d6c-aaef-e3a7ecb0fe0a tempest-ServersWithSpecificFlavorTestJSON-1415283028 tempest-ServersWithSpecificFlavorTestJSON-1415283028-project-member] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 800.817325] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 800.817325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.817325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.817325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.818890] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.914593] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.320537] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.320720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.320798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.321052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.321156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.321368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.321475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.321542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.321736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.321822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.321913] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be updated. [ 801.355301] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.355301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.355301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.355301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.355301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.364640] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: IN_PROGRESS for 2s [ 801.421212] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.927346] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.927575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.927632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.927823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.927916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.928028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 801.958985] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.959222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.959295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.959506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.959696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.970699] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 802.810953] env[69255]: INFO networking_nsxv3.common.synchronization [req-9f54bd76-c461-4678-bb79-bf55473e4352 req-0fdf3680-046a-4bfc-9216-39ed4a16e0a2 tempest-ServersNegativeTestJSON-1716894594 tempest-ServersNegativeTestJSON-1716894594-project-member] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 802.810953] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 802.810953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.810953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.810953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.813198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.813448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.813597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.813597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.815217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.815217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.815721] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.321610] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.375543] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 803.375543] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b deletion is rescheduled due to dependency. [ 803.375543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.428199] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.428199] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.428199] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.428199] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.428613] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.428961] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.429243] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.429603] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.429891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.430251] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.430841] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.431211] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.431507] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.431855] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.432071] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.432321] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.457209] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.457209] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.457209] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.457209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.457209] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-37cff32c-69e0-4af1-b0a3-e9fff731e705 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.457209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.457776] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.458217] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.458384] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37cff32c-69e0-4af1-b0a3-e9fff731e705',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.823547] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.963746] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.963959] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.964128] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.964376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.964523] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.964685] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 37cff32c-69e0-4af1-b0a3-e9fff731e705 not found, creating... [ 803.964954] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.965124] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.965242] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.965459] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.965607] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.965898] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.966079] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.966201] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.966483] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.966639] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.966782] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 37cff32c-69e0-4af1-b0a3-e9fff731e705 is going to be created. [ 803.981417] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 803.981579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.981748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.981976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.982177] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.982295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.982359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.982512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.982595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.982682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.982781] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.983991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.983991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.983991] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.984646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.984734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.984896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.985014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.985110] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.989899] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.989899] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.989899] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.991924] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.992200] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.992441] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.326214] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.326420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.326485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.326800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.326877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.327012] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 804.360863] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.361072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.361279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.361393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.361560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.370978] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 804.489966] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.489966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.495206] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.946348] env[69255]: INFO networking_nsxv3.common.synchronization [req-9f54bd76-c461-4678-bb79-bf55473e4352 req-3b614bee-6749-4ce5-8294-ddde552c68b8 service nova] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_rules [ 804.946671] env[69255]: INFO networking_nsxv3.common.synchronization [req-9f54bd76-c461-4678-bb79-bf55473e4352 req-3b614bee-6749-4ce5-8294-ddde552c68b8 service nova] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 804.946671] env[69255]: INFO networking_nsxv3.common.synchronization [req-9f54bd76-c461-4678-bb79-bf55473e4352 req-3b614bee-6749-4ce5-8294-ddde552c68b8 service nova] Enqueued Resource ID: 37cff32c-69e0-4af1-b0a3-e9fff731e705 with Priority: HIGHEST for action port [ 804.946923] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_rules [ 804.947205] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 804.947205] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37cff32c-69e0-4af1-b0a3-e9fff731e705 with Priority: HIGHEST for action port [ 804.947844] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.947971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.948643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.948955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.948955] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.950063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.950179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.950385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-37cff32c-69e0-4af1-b0a3-e9fff731e705 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.950490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.950758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.950758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.950914] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37cff32c-69e0-4af1-b0a3-e9fff731e705',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.981861] env[69255]: INFO networking_nsxv3.common.synchronization [req-825f2547-605e-4521-bcc9-9e6cd3d5ddd3 req-4f506eab-7e87-4f62-9048-21af3c717b05 tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 804.982576] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 804.983494] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.983638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.983721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.983934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.984137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.984240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.984301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.984471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.984541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.984643] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.998629] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.436637] env[69255]: INFO networking_nsxv3.common.synchronization [req-23f61eb8-94b4-4f8c-8dc4-c0864d0e2ccd req-76354bb0-3fd5-4e4c-8e57-769969b07322 tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 805.437729] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 805.437729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.437729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.437729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.437999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.438164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.438246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.438303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.438459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.438538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.438628] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.453570] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.453740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.453960] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37cff32c-69e0-4af1-b0a3-e9fff731e705 with status ACTIVE [ 805.454141] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.454262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.454327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.454541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.454628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.454807] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.454933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.455351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.455351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.455351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.455500] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.455661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.455720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.455834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.455915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.456019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37cff32c-69e0-4af1-b0a3-e9fff731e705 is going to be updated. [ 805.482921] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.483254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.483254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.483461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.483635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.483818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37cff32c-69e0-4af1-b0a3-e9fff731e705" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.487344] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.487481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.487977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.487977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.487977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.488294] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.488294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.488294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.488421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.488494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.488539] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be updated. [ 805.501310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.501474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.501582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.501773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.501870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.501967] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 805.554594] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.555215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.555215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.555215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.556028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.559153] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.559325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.559398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.559607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.559760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.569638] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 805.570340] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 805.943840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.943994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.944094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.944508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.944595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.944879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.945088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.945195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.945386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.945514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.945596] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 805.987859] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.987859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.987859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.987859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.987859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.998469] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 806.382819] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 806.382929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.383099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.383316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.383548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.383631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.383668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.383818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.383902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.384034] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.885876] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.388058] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.447171] env[69255]: INFO networking_nsxv3.common.synchronization [req-a1d777eb-af75-431a-8655-68a5cd93ea02 req-6528a0bc-455b-41b3-aadb-2d828a4bc25b tempest-ServerActionsV293TestJSON-738517794 tempest-ServerActionsV293TestJSON-738517794-project-member] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_members [ 807.447771] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGHEST for action security_group_members [ 807.449949] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.449949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.449949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.449949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.449949] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.450193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.450193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.450193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.450311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.450367] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.585240] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 807.585442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.587039] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 807.587211] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 deletion is rescheduled due to dependency. [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.589080] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.589080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.590367] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.590367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.590367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.590367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.590367] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.590367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.590367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.590367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.590806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.590806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.590806] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.894024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.894024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.894024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.894024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.894024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.894024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 807.925497] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.925664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.926061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.926061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.926195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.937652] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 807.953359] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.953599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.953684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.953909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.954069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.954304] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.954434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.954514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.954727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.954822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.954933] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf is going to be updated. [ 807.988355] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.988668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.988668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.988931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.989423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.001873] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64182064-3f41-4201-905f-0777a4b2f9cf in Status: IN_PROGRESS for 2s [ 808.009423] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 808.009775] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 808.009967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.095328] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fca696a-0f49-455d-9cb9-9f974821973b: rpc.has_security_group_logging(os_id): False [ 808.122858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.122858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.123110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.123300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.123381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.123758] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.123758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.124069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.124069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.124250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.124367] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.124521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.124521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.124715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.124791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.125751] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.125751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.125751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.125751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.125751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.125751] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 808.224352] env[69255]: INFO networking_nsxv3.common.synchronization [req-4aee1845-0c4f-4f3d-bbdd-5f6ffb5fad37 req-8dd9044d-d352-49c8-bfca-1aaa6d0eca47 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 808.229864] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 808.229864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.229864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.229864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.229864] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.284465] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.284690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.284778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.285034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.285399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.307556] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 808.736040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.736040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.736040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.736040] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 already deleted. [ 808.736908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.918382] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.918600] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.918745] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.919191] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.919672] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.919788] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.919885] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.920979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.920979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.921130] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.921168] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.921248] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.921405] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.921456] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.925037] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.925037] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.947572] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.948103] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 808.948103] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.948245] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.948681] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-e5c9debf-503a-450c-8628-c9bc823f4c21 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.950266] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.950266] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.950266] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.950266] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c9debf-503a-450c-8628-c9bc823f4c21',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.454802] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.454964] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.455115] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.455665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.455925] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.456120] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port e5c9debf-503a-450c-8628-c9bc823f4c21 not found, creating... [ 809.456450] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.456632] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.456764] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.458035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.458212] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.458447] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.458621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.458741] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.459026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.459192] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.461211] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: e5c9debf-503a-450c-8628-c9bc823f4c21 is going to be created. [ 809.487621] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.487621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.487621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.487621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.487621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.487621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.951867] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 809.951867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.951867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.952509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.952509] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.952509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.952509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.952792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.952792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.952792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.952913] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.012379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64182064-3f41-4201-905f-0777a4b2f9cf in Status: SUCCESS [ 810.012561] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf deletion is rescheduled due to dependency. [ 810.012685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.255530] env[69255]: INFO networking_nsxv3.common.synchronization [req-4aee1845-0c4f-4f3d-bbdd-5f6ffb5fad37 req-235686b5-5e14-4036-8cbf-7bc1c0f9a16d service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 810.255530] env[69255]: INFO networking_nsxv3.common.synchronization [req-4aee1845-0c4f-4f3d-bbdd-5f6ffb5fad37 req-235686b5-5e14-4036-8cbf-7bc1c0f9a16d service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 810.255530] env[69255]: INFO networking_nsxv3.common.synchronization [req-4aee1845-0c4f-4f3d-bbdd-5f6ffb5fad37 req-235686b5-5e14-4036-8cbf-7bc1c0f9a16d service nova] Enqueued Resource ID: e5c9debf-503a-450c-8628-c9bc823f4c21 with Priority: HIGHEST for action port [ 810.255530] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 810.255916] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 810.255916] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c9debf-503a-450c-8628-c9bc823f4c21 with Priority: HIGHEST for action port [ 810.258481] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.262143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.262143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.262143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.262143] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.263772] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.263927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.264034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.264333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.265234] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.265234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.265234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.265234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.265234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.265234] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.266885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5c9debf-503a-450c-8628-c9bc823f4c21 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.266885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.266885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.266885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.266885] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c9debf-503a-450c-8628-c9bc823f4c21',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.325699] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 810.325699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.325699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.325699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.326017] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.462257] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.462429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.462504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.462790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.463010] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.463288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.463288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.463434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.463563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.463704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.463989] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.464076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.465067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.465067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.465067] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.465067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.465067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.465067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.465067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.466057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.466057] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.769484] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.769681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.769972] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5c9debf-503a-450c-8628-c9bc823f4c21 with status ACTIVE [ 810.770066] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.770154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.770225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.770482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.770577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.770770] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.770889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.770950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.771147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.771230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.771419] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.771545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.771577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.771741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.771821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.771918] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5c9debf-503a-450c-8628-c9bc823f4c21 is going to be updated. [ 810.773150] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.799213] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.799395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.799475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.799646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.799924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.800015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5c9debf-503a-450c-8628-c9bc823f4c21" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.827992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.828256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.828361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.828554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.828732] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.828838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.828909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.829063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.829168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.829262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.829348] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.971633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d629ccb4-175d-4e83-941e-35fb3996c7a9: rpc.has_security_group_logging(os_id): False [ 810.993517] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6be777a-3ec1-41c2-bc0d-4d79b39aa5ae req-fc8130c2-5638-43af-b627-2f3b1c3245a8 tempest-ServersTestFqdnHostnames-596836303 tempest-ServersTestFqdnHostnames-596836303-project-member] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_members [ 810.994223] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_members [ 810.994652] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.994810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.994898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.995250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.995439] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.995582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.995700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.995997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.996113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.996219] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.001325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.001465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.001540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.001747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.001841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.002074] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.002205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.002308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.002658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.002921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.003160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.003331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.003389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.003552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.003631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.003818] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.004018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.004018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.004136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.004210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.004300] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 811.078514] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa690dd8-f84f-42a9-a453-6c9bb8bbfa80 req-5551eda6-cddb-48e6-8b7d-4b8020dff9e1 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 811.079443] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 811.080229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.080564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.080891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.081399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.081670] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.082000] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.082176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.082435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.082588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.082795] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.092180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.095314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.095314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.095314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.095314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.113727] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 811.275793] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.332563] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.332767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.457105] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa690dd8-f84f-42a9-a453-6c9bb8bbfa80 req-98146e7d-50ef-4c6c-a870-cd02c0ccdf63 tempest-ServersTestMultiNic-1560160158 tempest-ServersTestMultiNic-1560160158-project-member] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 811.457672] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGHEST for action security_group_members [ 811.457989] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.460478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.498684] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.498864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.498924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.499184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.499330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.499624] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.499747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.499820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.499989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.500085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.500174] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 already deleted. [ 811.500291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.571047] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-116 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.571047] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.571047] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.571860] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.572285] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.572621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.575066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.575066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.575066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.575066] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.575066] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.575066] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.575066] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.575066] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.575066] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.575066] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.585158] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.601035] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.601035] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 811.601035] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.601035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.601035] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-38a83fe4-973b-44f8-b1ba-f1dd351382b6 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.601035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.601035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.601592] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.601892] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a83fe4-973b-44f8-b1ba-f1dd351382b6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.782234] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.782234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.782234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.782234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.782234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.782234] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be created. [ 811.807758] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.807998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.807998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.808358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.808570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.821885] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: UNINITIALIZED for 2s [ 812.088422] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.105316] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.105529] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.105653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.106097] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.106309] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.106473] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 38a83fe4-973b-44f8-b1ba-f1dd351382b6 not found, creating... [ 812.106768] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.107051] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.107118] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.107386] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.107539] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.107840] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.108192] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.108402] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.108642] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.108784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.108932] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 38a83fe4-973b-44f8-b1ba-f1dd351382b6 is going to be created. [ 812.130619] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.130966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.131523] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.131954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.132352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.132743] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.593965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.593965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.593965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.593965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.593965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.593965] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 812.661115] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.665034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.665034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.665034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.665034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.675796] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 812.875158] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6be777a-3ec1-41c2-bc0d-4d79b39aa5ae req-354e45ca-a7ed-4b41-80ec-522de35b9515 service nova] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_rules [ 812.875355] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6be777a-3ec1-41c2-bc0d-4d79b39aa5ae req-354e45ca-a7ed-4b41-80ec-522de35b9515 service nova] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_members [ 812.875509] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6be777a-3ec1-41c2-bc0d-4d79b39aa5ae req-354e45ca-a7ed-4b41-80ec-522de35b9515 service nova] Enqueued Resource ID: 38a83fe4-973b-44f8-b1ba-f1dd351382b6 with Priority: HIGHEST for action port [ 812.876073] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_rules [ 812.876304] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_members [ 812.876304] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38a83fe4-973b-44f8-b1ba-f1dd351382b6 with Priority: HIGHEST for action port [ 812.876621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.876672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.876735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.876934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.877574] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.879035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.879199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.879301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.879630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.879739] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.879883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.879976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.880197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.880343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.880470] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.881348] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-38a83fe4-973b-44f8-b1ba-f1dd351382b6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.881510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.881617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.881806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.881918] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a83fe4-973b-44f8-b1ba-f1dd351382b6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.936760] env[69255]: INFO networking_nsxv3.common.synchronization [req-52e0c027-6512-4918-9d86-3f159c908575 req-d3f3c7c2-bb52-44d5-a556-30d1aae976d0 tempest-VolumesAssistedSnapshotsTest-1320610663 tempest-VolumesAssistedSnapshotsTest-1320610663-project-member] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_members [ 812.937293] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGHEST for action security_group_members [ 812.938335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.938487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.938531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.938710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.938855] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.938952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.939399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.939648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.939753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.939890] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.128768] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 813.129142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.383769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.383910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.384105] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.386197] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38a83fe4-973b-44f8-b1ba-f1dd351382b6 with status ACTIVE [ 813.386197] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.386197] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.386197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.386575] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.386575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.386575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.386678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.386709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.387818] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38a83fe4-973b-44f8-b1ba-f1dd351382b6 is going to be updated. [ 813.422239] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.423439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.423439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.423439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.423439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.423439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38a83fe4-973b-44f8-b1ba-f1dd351382b6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.443913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.443913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.443913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.443913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.443913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.443913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.443913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.443913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.444242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.444242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.444242] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 is going to be updated. [ 813.493826] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.494416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.495516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.495516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.497941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.506333] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 in Status: IN_PROGRESS for 2s [ 813.835116] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 813.835367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.835581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.835839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.838752] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.838752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.838752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.838752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.838752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.838752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.838752] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.889776] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.338904] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.339338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.339338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.339479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.339531] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.343133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.343285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.343567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.343649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.343709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.343929] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.344045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.344121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.344226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.344396] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.344486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.344550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.344674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.344752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.344851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.344947] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.392329] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.392329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.392678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.392678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.393177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.393177] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 is going to be created. [ 814.419547] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.419547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.419547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.421077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.421077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.436558] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22e932-32d8-43d0-87bb-f6563236db76 in Status: UNINITIALIZED for 2s [ 814.691035] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.691035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.691035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.692203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.692332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.692332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.692734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.692992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.693119] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.693195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.693367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.693466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.693554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.693644] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.696334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.696334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.696334] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.696334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.696334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.696334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.696334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.696334] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.847987] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 981734c6-752d-40c2-ba2a-3f068cd82111: rpc.has_security_group_logging(os_id): False [ 814.870175] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.870406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.870500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.870725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.870825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.871036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.871135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.871204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.871441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.871441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.871611] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.871683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.871751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.871887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.871964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.873067] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.873208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.873270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.873491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.873491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.873639] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be created. [ 814.951053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.951053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.951053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.951053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.951053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.958721] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f84b7d24-5e45-4c3d-9846-8c5244849a69 None None] Enqueued Resource ID: 3ed53688-852d-43eb-b221-6d69d02f5d4c with Priority: HIGHEST for action port [ 814.959478] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed53688-852d-43eb-b221-6d69d02f5d4c with Priority: HIGHEST for action port [ 814.959899] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed53688-852d-43eb-b221-6d69d02f5d4c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.960414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed53688-852d-43eb-b221-6d69d02f5d4c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.960414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed53688-852d-43eb-b221-6d69d02f5d4c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.960414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed53688-852d-43eb-b221-6d69d02f5d4c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.960648] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed53688-852d-43eb-b221-6d69d02f5d4c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.970355] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 815.198443] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fca696a-0f49-455d-9cb9-9f974821973b: rpc.has_security_group_logging(os_id): False [ 815.199940] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.200112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.200188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.200519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.202937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.202937] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.202937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.202937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.202937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.202937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.202937] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 815.243280] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.243532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.243532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.245137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.245137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.245137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.248622] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.248622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.248622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.248622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.249428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.249428] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be updated. [ 815.260385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.262850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.262850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.262850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.262850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.280631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 815.352764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.352764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.352764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.352764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.353504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.369446] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: IN_PROGRESS for 2s [ 815.464091] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ed53688-852d-43eb-b221-6d69d02f5d4c [ 815.464268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.464462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.464574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.464906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.465436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.465436] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ed53688-852d-43eb-b221-6d69d02f5d4c already deleted. [ 815.465436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed53688-852d-43eb-b221-6d69d02f5d4c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.518962] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 in Status: SUCCESS [ 815.519238] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 deletion is rescheduled due to dependency. [ 815.519355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.776875] env[69255]: INFO networking_nsxv3.common.synchronization [req-5f595940-bddb-47a9-9bf1-0d35c875481f req-f68e6aa8-a8df-4578-85d3-c8d2c143543a tempest-ListServerFiltersTestJSON-530012782 tempest-ListServerFiltersTestJSON-530012782-project-member] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 815.778238] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGHEST for action security_group_members [ 815.778629] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.778766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.778835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.779095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.779258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.779359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.779419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.779565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.779646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.779739] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.844740] env[69255]: INFO networking_nsxv3.common.synchronization [req-757bb4e1-13fa-486f-9b1f-68c3121453b0 req-c01dd5e7-a703-4a69-85ef-7f54feb23ae6 tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 815.845464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 815.845909] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.846041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.846088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.846404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.846643] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.846873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.846873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.847493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.847493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.847493] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.225907] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.226218] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.226359] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.226618] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.226884] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.227057] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.227175] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.227392] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.227532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.227737] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.227849] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.227960] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.228068] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.228247] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.228391] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.229174] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.247241] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.247410] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.247552] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.247734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-861" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.248068] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.250109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.250109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.250109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.250109] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a00bb7-f6f0-47ec-80ae-7ef61626c745',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.282320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.286025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.286025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.286025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be updated. [ 816.322359] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.322359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.322359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.322359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.322359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.330073] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: IN_PROGRESS for 2s [ 816.350583] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.447287] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22e932-32d8-43d0-87bb-f6563236db76 in Status: SUCCESS [ 816.447656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.447761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.447988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.448258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.448385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.448472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.448681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.448782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.448883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.449278] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.757025] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.757025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port a1a00bb7-f6f0-47ec-80ae-7ef61626c745 not found, creating... [ 816.757025] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.757025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.757586] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.757586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.757586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.757586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.760204] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.760665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: a1a00bb7-f6f0-47ec-80ae-7ef61626c745 is going to be created. [ 816.785894] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.786458] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.786642] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.787131] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.787499] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.787892] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.853646] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.951681] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.996439] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 816.996439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.293509] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 817.294052] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b deletion is rescheduled due to dependency. [ 817.294238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.358235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.358470] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.358574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.358813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.358939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.359103] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 817.384696] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fca696a-0f49-455d-9cb9-9f974821973b in Status: SUCCESS [ 817.384696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.400742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.400742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.400742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.400742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.400742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.411335] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 817.455547] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b22e932-32d8-43d0-87bb-f6563236db76: rpc.has_security_group_logging(os_id): False [ 817.474556] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.474695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.474777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.474992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.475092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.475343] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.475450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.475529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.475663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.475742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.475828] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 is going to be created. [ 817.547114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.547432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.547432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.547598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.547760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.565035] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22e932-32d8-43d0-87bb-f6563236db76 in Status: IN_PROGRESS for 2s [ 817.577302] env[69255]: INFO networking_nsxv3.common.synchronization [req-757bb4e1-13fa-486f-9b1f-68c3121453b0 req-89019c85-8612-4e48-9c1e-79d47f4cf006 service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 817.577495] env[69255]: INFO networking_nsxv3.common.synchronization [req-757bb4e1-13fa-486f-9b1f-68c3121453b0 req-89019c85-8612-4e48-9c1e-79d47f4cf006 service nova] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 817.580099] env[69255]: INFO networking_nsxv3.common.synchronization [req-757bb4e1-13fa-486f-9b1f-68c3121453b0 req-89019c85-8612-4e48-9c1e-79d47f4cf006 service nova] Enqueued Resource ID: a1a00bb7-f6f0-47ec-80ae-7ef61626c745 with Priority: HIGHEST for action port [ 817.580196] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_rules [ 817.580828] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 817.580966] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a00bb7-f6f0-47ec-80ae-7ef61626c745 with Priority: HIGHEST for action port [ 817.581293] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.581459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.582122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.582122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.582122] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.582692] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.582797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.582973] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.583193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.583342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.583498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.584015] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a00bb7-f6f0-47ec-80ae-7ef61626c745',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.593850] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.594095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.594095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.596077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.596077] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.088655] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.088897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.089057] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1a00bb7-f6f0-47ec-80ae-7ef61626c745 with status ACTIVE [ 818.089293] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.089458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.089555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.089834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.090011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.090246] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.090389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.090498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.090712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.090827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.091063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.091251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.091395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.091627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.091796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.091948] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1a00bb7-f6f0-47ec-80ae-7ef61626c745 is going to be updated. [ 818.096901] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.120013] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.121693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.121846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.122024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.122258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.122559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a00bb7-f6f0-47ec-80ae-7ef61626c745" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.342986] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 in Status: SUCCESS [ 818.342986] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 deletion is rescheduled due to dependency. [ 818.342986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.600158] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.604662] env[69255]: INFO networking_nsxv3.common.synchronization [req-ef54563e-5a77-423f-9d3c-3fb368aa91d6 req-ea4e654c-a8e5-494f-b6ec-d35aee07e2c2 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 818.606109] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 818.610673] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.610909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.611031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.611411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.611771] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.611881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.611919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.613190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.614106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.614106] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.078445] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.078618] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.078775] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.084381] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.084731] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.084997] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.085081] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.085337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.085489] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.085712] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.085827] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.085971] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.086217] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.086278] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.086486] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.086688] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.103595] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 819.103734] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 819.113681] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.113875] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.114040] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.114648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.115088] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-4c4f072b-8b51-401c-b65c-073966692cc8 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.115291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.116814] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.117331] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.117491] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c4f072b-8b51-401c-b65c-073966692cc8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.118636] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.118782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.118864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.119071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.119165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.119375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.119506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.119542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.119701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.119780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.119885] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 already deleted. [ 819.120008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.425136] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 819.425904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.425904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.425904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.426120] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.426189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.429021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.429021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.429021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.429021] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.580645] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b22e932-32d8-43d0-87bb-f6563236db76 in Status: SUCCESS [ 819.580973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.616377] env[69255]: INFO networking_nsxv3.common.synchronization [req-dc3aa469-fc70-400d-825e-5b27ac741ea8 req-a8900d86-e083-4d86-98bb-82f62c9abfe6 tempest-ServersNegativeTestJSON-1716894594 tempest-ServersNegativeTestJSON-1716894594-project-member] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 819.616977] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 819.617456] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.617626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.617703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.617907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.618091] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.618188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.618246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.618427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.618523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.618627] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.623350] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.623578] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.623737] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.624041] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.624218] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.624375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 4c4f072b-8b51-401c-b65c-073966692cc8 not found, creating... [ 819.624632] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.624791] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.624907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.625137] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.625280] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.625576] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.625746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.625868] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.626167] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.626370] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626524] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 4c4f072b-8b51-401c-b65c-073966692cc8 is going to be created. [ 819.649576] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.649848] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.649980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.652723] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.652723] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.652723] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.932859] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.103023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.103268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.103353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.103586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.116039] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 820.116970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.118245] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 820.121388] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.152121] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.152121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.152121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.152121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.160710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.160710] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 820.160856] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.160892] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 820.196721] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.196721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.196721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.197113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.198233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.198559] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 820.270267] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.270540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.270540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.270725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.271170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.271415] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 820.323522] env[69255]: INFO networking_nsxv3.common.synchronization [req-ef54563e-5a77-423f-9d3c-3fb368aa91d6 req-574d9fbd-4444-4983-bd45-8ad42528d701 service nova] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 820.323706] env[69255]: INFO networking_nsxv3.common.synchronization [req-ef54563e-5a77-423f-9d3c-3fb368aa91d6 req-574d9fbd-4444-4983-bd45-8ad42528d701 service nova] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 820.323848] env[69255]: INFO networking_nsxv3.common.synchronization [req-ef54563e-5a77-423f-9d3c-3fb368aa91d6 req-574d9fbd-4444-4983-bd45-8ad42528d701 service nova] Enqueued Resource ID: 4c4f072b-8b51-401c-b65c-073966692cc8 with Priority: HIGHEST for action port [ 820.324255] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 820.324425] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 820.324847] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4f072b-8b51-401c-b65c-073966692cc8 with Priority: HIGHEST for action port [ 820.325265] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.325404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.325404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.325853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.325925] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.327095] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.327233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.327349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.327550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.327740] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.327864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.328065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.328236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.328319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.328504] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.330254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c4f072b-8b51-401c-b65c-073966692cc8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.330254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.330254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.330254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.330254] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c4f072b-8b51-401c-b65c-073966692cc8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.332781] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.332909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.332909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.333077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.333286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.333519] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 820.333611] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'64182064-3f41-4201-905f-0777a4b2f9cf', '023e2804-8437-4f56-a0d0-5ae5351738e3', 'e9c48731-e921-4ad3-bc4e-fd9859b1fb0d', '81a64265-25ba-4ac7-84e1-066ecf8cecad', '6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315', 'd9a73172-9297-4dba-844d-93ad67b908a4', 'd629ccb4-175d-4e83-941e-35fb3996c7a9', '06344ad6-af9c-4558-b815-01d31d55ee0d', 'a228003c-531a-43cb-9396-964ab52c0831', '5a499bc4-6e98-47ff-b1a3-d708876db0c4', '2949be13-f858-4157-91a1-664036bdd8ee', 'bf69e078-c36c-4fbc-aa38-e9cd0dd506de', '5d36f190-eca4-498f-b2be-5b1977c816d8', '898ea5ad-b2b6-409a-b279-b3855ff08553', '8c6e4769-ef78-4ddb-90a5-bf7e3beea06a', '39f23576-868c-480d-b556-0aad9680f300', '69a6662a-ad20-4a62-a1cd-f2b43eb61276', '1e308c59-2d78-4b4d-bb22-c5f49be97eca', '8d189f5a-d78d-42ab-a62b-b890fa2ed59b', '60b17549-d298-4dfe-a54f-a61c4d6ac8f2', 'b860cf4f-f007-40a7-9732-dcaeb48217fc', '4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca', '7af381e4-0258-42b9-9d7f-b2370cc5a4ae', 'f33ed09a-fe24-4b0c-9bbd-6935d7eac81b', '1fca696a-0f49-455d-9cb9-9f974821973b', 'a3c78b55-33cd-47e8-95aa-4dc1be978038', '8b22e932-32d8-43d0-87bb-f6563236db76', '8b73d257-772b-49ed-a193-0adc505752e2', '97be36bb-9aa7-4ca4-9b9b-f2f13467259b', 'bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6', '7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3', 'a1cc7026-1d45-4ec0-a32d-311a913b774a', '39207596-4602-4c59-b143-d5038ebffb91', 'd8f85b08-83ad-443d-9e32-5acb05ba6b8e', '981734c6-752d-40c2-ba2a-3f068cd82111', 'e55ab758-8173-4602-9e5f-c4388eb52159'} {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.333769] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 820.353235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.353499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.353499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.353697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.353748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.353821] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 820.353883] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.354263] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 820.420057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.420386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.420489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.420827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.422044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.422345] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 820.422459] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.422549] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 820.422633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 820.422733] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 820.422817] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGH for action security_group_rules [ 820.422895] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGH for action security_group_rules [ 820.422985] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGH for action security_group_rules [ 820.423097] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGH for action security_group_rules [ 820.423165] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGH for action security_group_rules [ 820.423225] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGH for action security_group_rules [ 820.423272] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGH for action security_group_rules [ 820.423335] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGH for action security_group_rules [ 820.423430] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGH for action security_group_rules [ 820.423504] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGH for action security_group_rules [ 820.423575] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGH for action security_group_rules [ 820.423620] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGH for action security_group_rules [ 820.423683] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGH for action security_group_rules [ 820.423760] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGH for action security_group_rules [ 820.423932] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGH for action security_group_rules [ 820.423932] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGH for action security_group_rules [ 820.424117] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGH for action security_group_rules [ 820.424117] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGH for action security_group_rules [ 820.424117] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGH for action security_group_rules [ 820.424325] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGH for action security_group_rules [ 820.424403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.438489] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.628889] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.837647] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.837797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.838014] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.839026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c4f072b-8b51-401c-b65c-073966692cc8 with status ACTIVE [ 820.839223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.839400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.839512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.839702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.839791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.839966] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.840077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.840139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.840288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.840363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.840549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.841342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.841342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.841342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.841342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.841342] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c4f072b-8b51-401c-b65c-073966692cc8 is going to be updated. [ 820.864473] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.864666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.864707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.864894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.865043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.865203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.940669] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.940844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.940915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.941177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.941290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.941352] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 820.975790] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.975940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.976019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.976238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.976386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.985045] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 821.133036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.133036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.133036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.134025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.138022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.138022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 821.171217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.171373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.171373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.172217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.172217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.184405] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 821.343176] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.397449] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7b1e91e-9b35-4283-9e8d-3ba0e605067a req-0d39f746-381c-4a53-a1ce-30befe77c92c tempest-ServersV294TestFqdnHostnames-1174110639 tempest-ServersV294TestFqdnHostnames-1174110639-project-member] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_members [ 821.398075] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_members [ 821.398232] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64182064-3f41-4201-905f-0777a4b2f9cf with Priority: HIGH for action security_group_rules [ 821.398337] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d with Priority: HIGH for action security_group_rules [ 821.398461] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGH for action security_group_rules [ 821.398570] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a with Priority: HIGH for action security_group_rules [ 821.398668] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGH for action security_group_rules [ 821.398766] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b with Priority: HIGH for action security_group_rules [ 821.398846] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca with Priority: HIGH for action security_group_rules [ 821.398928] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 with Priority: HIGH for action security_group_rules [ 821.400042] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 with Priority: HIGH for action security_group_rules [ 821.400184] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGH for action security_group_rules [ 821.400288] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGH for action security_group_rules [ 821.400388] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de with Priority: HIGH for action security_group_rules [ 821.400485] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2949be13-f858-4157-91a1-664036bdd8ee with Priority: HIGH for action security_group_rules [ 821.400579] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 with Priority: HIGH for action security_group_rules [ 821.400670] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGH for action security_group_rules [ 821.400784] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGH for action security_group_rules [ 821.400881] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06344ad6-af9c-4558-b815-01d31d55ee0d with Priority: HIGH for action security_group_rules [ 821.401085] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 with Priority: HIGH for action security_group_rules [ 821.401085] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 with Priority: HIGH for action security_group_rules [ 821.401163] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad with Priority: HIGH for action security_group_rules [ 821.401448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.401573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.401632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.401905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.402095] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.402197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.402250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.402405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.402490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.402584] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.403517] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64182064-3f41-4201-905f-0777a4b2f9cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.403644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.403696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.403844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.403921] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64182064-3f41-4201-905f-0777a4b2f9cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.404731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.404849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.404904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.405055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.405121] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c48731-e921-4ad3-bc4e-fd9859b1fb0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.406015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.406015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.406015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.406197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.406253] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.410052] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.410052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.410052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.410052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.410052] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c6e4769-ef78-4ddb-90a5-bf7e3beea06a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.410052] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.410052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.410052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.410052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.410052] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.410620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.410620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.410620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.410774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.410774] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d189f5a-d78d-42ab-a62b-b890fa2ed59b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.411660] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.412084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.412487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.413554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.413554] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e308c59-2d78-4b4d-bb22-c5f49be97eca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.413735] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.413858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.413858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.414078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.414172] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69a6662a-ad20-4a62-a1cd-f2b43eb61276',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.415261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-898ea5ad-b2b6-409a-b279-b3855ff08553 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.415370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.415437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.415586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.415657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('898ea5ad-b2b6-409a-b279-b3855ff08553',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.415891] env[69255]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 821.416863] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.417036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.417140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.417296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.417394] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.418489] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.418577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.418767] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.418863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.418926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.419088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.419161] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf69e078-c36c-4fbc-aa38-e9cd0dd506de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.419955] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2949be13-f858-4157-91a1-664036bdd8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.420078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.420144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.420293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.420369] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2949be13-f858-4157-91a1-664036bdd8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.421403] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.421640] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.421682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.421880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.421987] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a499bc4-6e98-47ff-b1a3-d708876db0c4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.423035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.423137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.423183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.423332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.423405] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.424265] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.424371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.424439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.424587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.424658] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.425603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06344ad6-af9c-4558-b815-01d31d55ee0d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.425706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.425772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.425931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.426019] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06344ad6-af9c-4558-b815-01d31d55ee0d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.426815] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.426916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.426982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.427143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.427215] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.428027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-023e2804-8437-4f56-a0d0-5ae5351738e3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.428137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.428204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.428352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.428435] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('023e2804-8437-4f56-a0d0-5ae5351738e3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.429316] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a64265-25ba-4ac7-84e1-066ecf8cecad taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.429421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.429492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.429636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.429705] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a64265-25ba-4ac7-84e1-066ecf8cecad',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.429916] env[69255]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 821.434493] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.434609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.434675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.434842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.434929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.435182] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.435334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.435408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.435550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.435630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.435713] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 already deleted. [ 821.435790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.704279] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.704574] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-811" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.704626] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-811" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.704985] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-811" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.708963] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.709115] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.709237] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.709574] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.709802] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.710032] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.710219] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.710363] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.710531] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.710703] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.710871] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.711059] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.732123] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.732353] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.732527] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.732739] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-811" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.733111] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-314ab5fe-b928-4498-8d15-afa5576859de taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.733323] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.733486] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.733858] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.734017] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('314ab5fe-b928-4498-8d15-afa5576859de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.847523] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.847726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.847778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.848051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.848155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.848257] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be created. [ 821.883035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.883270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.883385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.883640] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.883855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.893766] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: UNINITIALIZED for 2s [ 821.955092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.955627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.955787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.956558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.960529] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.960637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.966347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.966587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.966717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.967016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.967601] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.967720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.967773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.967987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.968107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.968227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.968370] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.974063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.974063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.974063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.974063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.974063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.974063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.974497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.974538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.974636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.974737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.974823] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.981138] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.981354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.982835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.982971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.983066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.984565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.984565] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.984565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.984565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.984565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.984565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.984565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.984565] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.002390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.002608] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64182064-3f41-4201-905f-0777a4b2f9cf is going to be deleted. [ 822.011971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.012231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.047597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.047762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.054567] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.054567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.059376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.059622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.062109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.062352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.063201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.063283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.063990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.064103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.064911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.065014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.072393] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.072522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.073323] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.073432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.074261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.074361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.075058] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.075527] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.075656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.076436] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.076918] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.077040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.078619] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.079326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.079326] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c48731-e921-4ad3-bc4e-fd9859b1fb0d is going to be deleted. [ 822.080162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.080396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.081880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.082058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.105774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.105936] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e308c59-2d78-4b4d-bb22-c5f49be97eca is going to be deleted. [ 822.106909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.107136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.130901] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.130901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.133038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.133038] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 023e2804-8437-4f56-a0d0-5ae5351738e3 is going to be deleted. [ 822.133770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.133972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.154738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.154925] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a499bc4-6e98-47ff-b1a3-d708876db0c4 is going to be deleted. [ 822.156246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.156472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.158717] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.158865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.180435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.180607] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69a6662a-ad20-4a62-a1cd-f2b43eb61276 is going to be deleted. [ 822.181532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.181749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.237336] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.237336] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.237500] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.237854] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.238039] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.238221] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 314ab5fe-b928-4498-8d15-afa5576859de not found, creating... [ 822.238711] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.238911] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.239071] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.239353] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.239588] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.240029] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.240249] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.240372] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.240620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.240839] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.241017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 314ab5fe-b928-4498-8d15-afa5576859de is going to be created. [ 822.248051] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.248243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.281704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.281704] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf69e078-c36c-4fbc-aa38-e9cd0dd506de is going to be deleted. [ 822.283432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.283779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.286843] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.287210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.311120] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.311410] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.311545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.311981] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.312324] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.312512] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.331519] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.331731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.435779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.435779] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c6e4769-ef78-4ddb-90a5-bf7e3beea06a is going to be deleted. [ 822.435779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.436361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.438271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.438490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.486261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.486395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.486513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.488210] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.488210] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.488210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.488609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.488609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.490030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.490030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.490030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.490030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.490030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.490030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.490385] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.504027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.504027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.504027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.504027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.505959] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.505959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.505959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.505959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.505959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.505959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.505959] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.508019] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.515239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.515239] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06344ad6-af9c-4558-b815-01d31d55ee0d is going to be deleted. [ 822.515239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.515239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.537939] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.537939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.580139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.580139] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be deleted. [ 822.580583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.581038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.637599] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.637794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.651236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.651236] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 898ea5ad-b2b6-409a-b279-b3855ff08553 is going to be deleted. [ 822.651513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.651837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.735029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.735029] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2949be13-f858-4157-91a1-664036bdd8ee is going to be deleted. [ 822.735029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.735029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.736785] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.737131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.737933] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.738170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.787317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.787317] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315 is going to be deleted. [ 822.787317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.787317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.828589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.828589] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d189f5a-d78d-42ab-a62b-b890fa2ed59b is going to be deleted. [ 822.828589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.828589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.860962] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.861219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.871761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.871761] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a64265-25ba-4ac7-84e1-066ecf8cecad is going to be deleted. [ 822.871761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.871761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.871761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.871761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64182064-3f41-4201-905f-0777a4b2f9cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.871761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.872038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.872038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.874065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c48731-e921-4ad3-bc4e-fd9859b1fb0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.874065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.874065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.874065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.874329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e308c59-2d78-4b4d-bb22-c5f49be97eca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.874483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.874614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.874782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.874823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-023e2804-8437-4f56-a0d0-5ae5351738e3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.875125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.875125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.875326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.875326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a499bc4-6e98-47ff-b1a3-d708876db0c4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.875420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.875651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.876032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.876161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69a6662a-ad20-4a62-a1cd-f2b43eb61276" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.876424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.876573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.876649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.876755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf69e078-c36c-4fbc-aa38-e9cd0dd506de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.876879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.877027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.877100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.877217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c6e4769-ef78-4ddb-90a5-bf7e3beea06a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.877577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.877725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.877801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.877930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06344ad6-af9c-4558-b815-01d31d55ee0d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.878126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.878219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.878292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.878400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.878553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.878689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.878763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.878865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-898ea5ad-b2b6-409a-b279-b3855ff08553" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.930236] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.930429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.932984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.933184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.933276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.933431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2949be13-f858-4157-91a1-664036bdd8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.975161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.975477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.975575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.975989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.976258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.976708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c8f8ccc-26e7-4d1c-8f10-654d5c5c5315" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.993395] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.993596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.993669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.993885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.993982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.994109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d189f5a-d78d-42ab-a62b-b890fa2ed59b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.994351] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a228003c-531a-43cb-9396-964ab52c0831: rpc.has_security_group_logging(os_id): False [ 823.007836] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 823.008288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.008918] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a73172-9297-4dba-844d-93ad67b908a4: rpc.has_security_group_logging(os_id): False [ 823.010784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.011297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.011680] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.011875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.011989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.012239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.012373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.012516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.012679] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.014334] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60b17549-d298-4dfe-a54f-a61c4d6ac8f2: rpc.has_security_group_logging(os_id): False [ 823.040099] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.040459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.040503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.041849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.043119] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.043892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.074134] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.074328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.079120] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 823.079814] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.080448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.131093] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 823.131329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.131637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.131767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.131823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.132046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.132138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.132358] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.133370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.133370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.133370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.133370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.133370] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.133632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.133632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.133900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.133999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.134613] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be updated. [ 823.135607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.135724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.191738] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7b1e91e-9b35-4283-9e8d-3ba0e605067a req-9a8ffb14-0675-446f-93ad-cfa0bcdbc512 service nova] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_rules [ 823.191738] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7b1e91e-9b35-4283-9e8d-3ba0e605067a req-9a8ffb14-0675-446f-93ad-cfa0bcdbc512 service nova] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_members [ 823.191738] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7b1e91e-9b35-4283-9e8d-3ba0e605067a req-9a8ffb14-0675-446f-93ad-cfa0bcdbc512 service nova] Enqueued Resource ID: 314ab5fe-b928-4498-8d15-afa5576859de with Priority: HIGHEST for action port [ 823.191738] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_rules [ 823.191738] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_members [ 823.191738] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 314ab5fe-b928-4498-8d15-afa5576859de with Priority: HIGHEST for action port [ 823.191738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.192369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.192369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.192369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.192369] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.193126] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.193246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.193302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.193504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.193653] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.193727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.193798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.193946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.194040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.194137] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.195049] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-314ab5fe-b928-4498-8d15-afa5576859de taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.195140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.195177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.195627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.195627] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('314ab5fe-b928-4498-8d15-afa5576859de',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.208330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 823.208636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.208817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.209046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.209245] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.209363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.209428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.209611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.209696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.209783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.209875] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.226541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.226872] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.227037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.227136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.227453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.227569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.227806] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.227914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.227981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.228209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.228323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.228611] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.228836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.228836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.228987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.228987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.230443] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be updated. [ 823.231745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.231946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.315306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.315306] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.315306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.315306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.315306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.315306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.315306] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 is going to be updated. [ 823.317493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.318264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.318657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.319036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a64265-25ba-4ac7-84e1-066ecf8cecad" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.367413] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.368316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.368648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.370025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.370025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.374229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.374359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.374442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.374613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.374782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.411989] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 823.417011] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 823.479106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.479325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.479480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.479735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.479959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.502200] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: IN_PROGRESS for 2s [ 823.514883] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.515108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.515186] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.515544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.515767] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.515898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.515965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.516163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.516258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.516348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.516545] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.516663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.516663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.516828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.516971] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.517084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.517162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.517277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.517345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.517445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.517540] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.700950] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.700950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.700950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.700950] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 314ab5fe-b928-4498-8d15-afa5576859de with status ACTIVE [ 823.700950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.700950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.700950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.700950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.700950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.700950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.700950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.702754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.706621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.706621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.706621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.706621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.706621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.706621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.706621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.706621] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 314ab5fe-b928-4498-8d15-afa5576859de is going to be updated. [ 823.716967] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.717150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.717328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.717438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.717775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.717775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.717775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.717932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.717992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.718086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.718237] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.718365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.718406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.718546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.718731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.718917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.718917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.719284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.719284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.719396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.719396] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.735094] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.735473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.735473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.735568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.735787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.735896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-314ab5fe-b928-4498-8d15-afa5576859de" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.904016] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 823.904484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.904778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.905188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.905500] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.905718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.905866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.906142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.906328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.906517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.906684] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.020121] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d36f190-eca4-498f-b2be-5b1977c816d8: rpc.has_security_group_logging(os_id): False [ 824.042188] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.042364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.042415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.042634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.066070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.066340] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.066469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.066554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.066768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.066856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.067083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.067232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.067280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.067400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.067475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.067715] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.067779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.067811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.067952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.068455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.068654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 824.153572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.153726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.153798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.154094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.154256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.176134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 824.209961] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.222878] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d629ccb4-175d-4e83-941e-35fb3996c7a9: rpc.has_security_group_logging(os_id): False [ 824.254684] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.254865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.254928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.255205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.293597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.294073] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.294288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.294391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.294699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.294826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.295534] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.295812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.295980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.296290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.296479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.297135] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.297375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.297514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.297852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.298047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.298232] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 824.380066] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.380272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.380321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.380570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.380738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.405583] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 824.410195] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.410358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.410431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.410670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.410838] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.410972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.411051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.411230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.411323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.411416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.411583] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.411695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.411757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.411970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.412070] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.412176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.412237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.412395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.412482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.412579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.412696] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.713312] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.713488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.713605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.713911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.713911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.714054] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 is going to be created. [ 824.743457] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.743823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.743823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.743914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.744067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.757481] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d24a10fe-fb92-4749-8ef6-b825581376a8 in Status: UNINITIALIZED for 2s [ 824.915222] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e916b5-2321-4083-a362-4d91a75f9d62: rpc.has_security_group_logging(os_id): False [ 824.934305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.934305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.934305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.934484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.934484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.934752] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.934752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.934917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.935286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.935286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.935286] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.935404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.935404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.935495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.935569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.935739] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.935831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.935884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.936016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.936089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.936699] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be created. [ 825.006652] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.006652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.006652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.006652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.006652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.024025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 825.435291] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 825.435617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.436400] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 825.436585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.518020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: SUCCESS [ 825.518256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.190444] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 826.190814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.191153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.191153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.191153] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.423552] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 826.423935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.695433] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.695605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.695670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.695898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696068] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.696169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.696226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.696377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.696546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.696742] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.767796] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d24a10fe-fb92-4749-8ef6-b825581376a8 in Status: SUCCESS [ 826.768064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.768608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.768608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.769200] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.769200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.769200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.769399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.769399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.769399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.769527] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.039185] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 827.040485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.199416] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.199959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.199959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.200637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.201383] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.201597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.201683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.201888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.201984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.202092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.202258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.202360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.202425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.202576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.202711] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.202807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.202970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.203025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.204605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.204728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.204835] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.272852] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.708635] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d36f190-eca4-498f-b2be-5b1977c816d8: rpc.has_security_group_logging(os_id): False [ 827.734536] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.734952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.737256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.737256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.737256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.737736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.737976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.738462] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.738878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.739106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.739582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.739994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.740255] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.740407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.740497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.740911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.740911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.740911] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 827.781195] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d24a10fe-fb92-4749-8ef6-b825581376a8: rpc.has_security_group_logging(os_id): False [ 827.803295] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.803295] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.803295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.803295] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 is going to be created. [ 827.824524] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.824686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.824760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.824975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.825143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.839983] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 827.904926] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.906883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.910355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.910751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.911167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.943842] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d24a10fe-fb92-4749-8ef6-b825581376a8 in Status: IN_PROGRESS for 2s [ 828.193146] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 828.193146] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 829.236866] env[69255]: INFO networking_nsxv3.common.synchronization [req-727f8c45-05b4-4c5d-bac1-2faf5cef1fef req-0715b918-bb0e-4653-8a43-9584daa4b409 tempest-VolumesAdminNegativeTest-714470093 tempest-VolumesAdminNegativeTest-714470093-project-member] Enqueued Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_members [ 829.246709] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_members [ 829.246709] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.246709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.246709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.246709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.247866] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.247866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.247866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.247866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.247866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.247866] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.749746] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.749932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.750012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.750298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.750398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.750625] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.750747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.750816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.750986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.751194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.751194] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fa580c-2432-422e-a13f-1995d2283ac0 already deleted. [ 829.751325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.862946] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 829.863176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.924265] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.924471] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.924606] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.924922] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.925169] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.925444] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.925555] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.925867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.925978] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.926292] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.926372] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.926450] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.927034] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.927034] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.927034] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.927034] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.960214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.960214] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.960214] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.960365] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-762" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.962282] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.962282] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.962282] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.962282] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.962282] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f3bd1b4-5568-4bfc-99e7-4b7f93597844',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.965673] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d24a10fe-fb92-4749-8ef6-b825581376a8 in Status: SUCCESS [ 829.965673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.466689] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.467190] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.467190] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.467665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.467665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.467665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 8f3bd1b4-5568-4bfc-99e7-4b7f93597844 not found, creating... [ 830.467955] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.468152] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.468277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.468504] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.468645] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.468957] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.469561] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.469709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.469923] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.470072] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.470225] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 8f3bd1b4-5568-4bfc-99e7-4b7f93597844 is going to be created. [ 830.494683] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.494987] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.495315] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.495315] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.495559] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.495782] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.765923] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 830.766183] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 830.766848] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 830.767162] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 830.767525] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.767660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.767718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.767938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.768121] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.768242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.768278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.768417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.768486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.768636] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.769520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.769685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.769797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.770109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.770377] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.770460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.770527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.770705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.770793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.770900] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.923008] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 830.923214] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 830.923351] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_rules [ 830.923480] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 830.923605] env[69255]: INFO networking_nsxv3.common.synchronization [req-8c57f0ca-3b58-4970-bc6c-c85af9c07cb2 req-61ba5b7f-6e35-4850-9546-910a02ff15de tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 4c4f072b-8b51-401c-b65c-073966692cc8 with Priority: HIGHEST for action port [ 830.924378] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 830.924518] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_rules [ 830.924617] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4f072b-8b51-401c-b65c-073966692cc8 with Priority: HIGHEST for action port [ 830.925046] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 830.925046] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 830.925158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.925218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.925266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.925480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.925549] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.926656] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.927028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.927124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.927385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.927450] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.928256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c4f072b-8b51-401c-b65c-073966692cc8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.928412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.928449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.928724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.928724] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c4f072b-8b51-401c-b65c-073966692cc8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.929382] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.929479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.930118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.930118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.421095] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.427350] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.432231] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.432231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.432231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c4f072b-8b51-401c-b65c-073966692cc8 with status ACTIVE [ 831.432231] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.432231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.432231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.432231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.432231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.432231] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.432879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.432879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.432879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.432879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.433250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.433366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.433366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.433642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.433716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.433906] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c4f072b-8b51-401c-b65c-073966692cc8 is going to be updated. [ 831.435226] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.435413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.446752] env[69255]: INFO networking_nsxv3.common.synchronization [req-727f8c45-05b4-4c5d-bac1-2faf5cef1fef req-878d494c-9540-4784-bf0e-adce7ddf718f service nova] Enqueued Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_rules [ 831.446975] env[69255]: INFO networking_nsxv3.common.synchronization [req-727f8c45-05b4-4c5d-bac1-2faf5cef1fef req-878d494c-9540-4784-bf0e-adce7ddf718f service nova] Enqueued Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_members [ 831.447126] env[69255]: INFO networking_nsxv3.common.synchronization [req-727f8c45-05b4-4c5d-bac1-2faf5cef1fef req-878d494c-9540-4784-bf0e-adce7ddf718f service nova] Enqueued Resource ID: 8f3bd1b4-5568-4bfc-99e7-4b7f93597844 with Priority: HIGHEST for action port [ 831.447646] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_rules [ 831.447782] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_members [ 831.447879] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f3bd1b4-5568-4bfc-99e7-4b7f93597844 with Priority: HIGHEST for action port [ 831.449628] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.449628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.449757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.450024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.450161] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.452998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.453254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.453254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.454681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.454681] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.454681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.454681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.454681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.454681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.454681] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.456124] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.456289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.456361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.456578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.456656] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f3bd1b4-5568-4bfc-99e7-4b7f93597844',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.465549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.465756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.465804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.466040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.466270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.466478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.594686] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 831.596359] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 831.596359] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_members [ 831.596359] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 831.596359] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 831.596359] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_members [ 831.602398] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.602586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.602917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.603058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.603336] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f8404c-0625-4de4-9522-49bae286c6f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.603493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.603560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.604155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.604310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.604436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.604522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.604835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.605016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.605275] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.657753] env[69255]: INFO networking_nsxv3.common.synchronization [req-6a1ffc1e-7be9-41d4-ab4d-5549e9adf8fe req-9e3d31d8-47a6-47f7-b11b-4e0a98958679 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 831.659104] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 831.659637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.659917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.660026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.660275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.660474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.660657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.660779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.661070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.661230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.661296] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.693947] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 831.694261] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 831.694443] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_rules [ 831.694773] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 831.695077] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_rules [ 831.695616] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_members [ 831.695872] env[69255]: INFO networking_nsxv3.common.synchronization [req-1c07fe3f-0db0-4175-b4c7-c4327e0576ad req-c7d648cc-e38b-420e-ad06-ff801cecfac3 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 4c4f072b-8b51-401c-b65c-073966692cc8 with Priority: HIGHEST for action port [ 831.699015] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 831.699301] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_rules [ 831.699526] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_members [ 831.699657] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4f072b-8b51-401c-b65c-073966692cc8 with Priority: HIGHEST for action port [ 831.699895] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_rules [ 831.700418] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 831.700600] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 831.701690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.701815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.702202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.702558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.702916] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f8404c-0625-4de4-9522-49bae286c6f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.703029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.703273] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c4f072b-8b51-401c-b65c-073966692cc8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.703376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.703456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.703674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.703757] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c4f072b-8b51-401c-b65c-073966692cc8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.704723] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f8404c-0625-4de4-9522-49bae286c6f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.704855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.704923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.706072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.706187] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.707902] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.707987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.708261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.708391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.923829] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.930778] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.958379] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.959572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.959735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.964379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f3bd1b4-5568-4bfc-99e7-4b7f93597844 with status ACTIVE [ 831.964659] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.964774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.964840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.965055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.965152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.965356] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.965462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.965513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.965655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.965725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.966439] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.966439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.966439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.966439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.966439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.966439] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f3bd1b4-5568-4bfc-99e7-4b7f93597844 is going to be updated. [ 831.997715] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.997902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.998140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.998264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.998448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.998617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f3bd1b4-5568-4bfc-99e7-4b7f93597844" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.107915] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.165920] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.166139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.166392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.166470] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.195121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.195121] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.195121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.195121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.195509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.195509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.195509] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 832.211231] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f8404c-0625-4de4-9522-49bae286c6f7 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.211231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.211231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c4f072b-8b51-401c-b65c-073966692cc8 with status ACTIVE [ 832.211607] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.211607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.211607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.211832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.211918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.212177] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.212273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.212352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.212521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.212684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.212841] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.212938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.213009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.213174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.213252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.213353] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c4f072b-8b51-401c-b65c-073966692cc8 is going to be updated. [ 832.251015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.251230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.251547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.251810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.252236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.252429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c4f072b-8b51-401c-b65c-073966692cc8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.255409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.255607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.255607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.255923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.256078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.273170] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 832.426597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.426770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.426846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.427134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.427235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.427354] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 832.435192] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.435192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.435192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.435192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.435192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.435192] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be created. [ 832.458125] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.458301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.458382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.458546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.458699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.460592] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.462379] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.462542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.462607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.462766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.462906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.471017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: UNINITIALIZED for 2s [ 832.471869] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 832.541363] env[69255]: INFO networking_nsxv3.common.synchronization [None req-68bf3505-2960-44cb-beb1-1c17aedf8406 None None] Enqueued Resource ID: 3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98 with Priority: HIGHEST for action port [ 832.542840] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98 with Priority: HIGHEST for action port [ 832.543369] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.543597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.543713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.544205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.544395] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.606525] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.606525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.606525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.606525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.606525] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.606525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.606525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.607797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.608488] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.608488] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.608811] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.609215] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.610026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.610026] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.610026] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.610026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.613321] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.640206] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.640206] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.640206] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.640566] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.640648] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-606b085e-1f22-4f78-a866-0c824c54896a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.640817] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.640943] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.642153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.642153] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606b085e-1f22-4f78-a866-0c824c54896a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.965247] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.965426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.965499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.965713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.965804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.965903] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fa580c-2432-422e-a13f-1995d2283ac0 is going to be created. [ 832.996365] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.996528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.996528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.996749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.997213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.010781] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fa580c-2432-422e-a13f-1995d2283ac0 in Status: UNINITIALIZED for 2s [ 833.051562] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98 [ 833.051869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.052213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.052363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.052682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.052844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.053008] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98 already deleted. [ 833.053158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3561d7b3-b7db-4d3f-b4c6-5cfbb24f0d98" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.114676] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.114845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.114892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.115124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.115241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.115349] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f8404c-0625-4de4-9522-49bae286c6f7 is going to be created. [ 833.144449] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.144829] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.145055] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.145376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.145526] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.145697] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 606b085e-1f22-4f78-a866-0c824c54896a not found, creating... [ 833.145986] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.146181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.146310] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.146557] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.146706] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.147167] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.147377] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.147500] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.147728] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.147870] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.148039] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 606b085e-1f22-4f78-a866-0c824c54896a is going to be created. [ 833.150062] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.150190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.150263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.150430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.150582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.165690] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: UNINITIALIZED for 2s [ 833.172758] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.172979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.174014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.174014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.174014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.174014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.288829] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 834.289204] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 834.289204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.403833] env[69255]: INFO networking_nsxv3.common.synchronization [req-6a1ffc1e-7be9-41d4-ab4d-5549e9adf8fe req-411815a1-aed7-4a46-ba29-b159a45829dc service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 834.403833] env[69255]: INFO networking_nsxv3.common.synchronization [req-6a1ffc1e-7be9-41d4-ab4d-5549e9adf8fe req-411815a1-aed7-4a46-ba29-b159a45829dc service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 834.403833] env[69255]: INFO networking_nsxv3.common.synchronization [req-6a1ffc1e-7be9-41d4-ab4d-5549e9adf8fe req-411815a1-aed7-4a46-ba29-b159a45829dc service nova] Enqueued Resource ID: 606b085e-1f22-4f78-a866-0c824c54896a with Priority: HIGHEST for action port [ 834.403833] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 834.404466] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 834.404707] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606b085e-1f22-4f78-a866-0c824c54896a with Priority: HIGHEST for action port [ 834.405589] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.408020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.408020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.408020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.408020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.409265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.409502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.409891] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.413584] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-606b085e-1f22-4f78-a866-0c824c54896a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.413584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.413584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.413584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.413584] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606b085e-1f22-4f78-a866-0c824c54896a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.461220] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a2071fd9-526e-46af-baa9-913ab3998035 None None] Enqueued Resource ID: 8cb93489-ac76-4653-81c1-c5d843e02116 with Priority: HIGHEST for action port [ 834.461220] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb93489-ac76-4653-81c1-c5d843e02116 with Priority: HIGHEST for action port [ 834.461449] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cb93489-ac76-4653-81c1-c5d843e02116 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.461754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cb93489-ac76-4653-81c1-c5d843e02116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.462095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cb93489-ac76-4653-81c1-c5d843e02116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.462504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cb93489-ac76-4653-81c1-c5d843e02116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.462779] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cb93489-ac76-4653-81c1-c5d843e02116',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.492611] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 834.492887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.493858] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 834.494079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.494270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.495382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.495679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.495773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.495840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.496062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.496167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.496286] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.497804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.498095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.498293] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.498400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.498472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.498625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.498701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.498792] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.915030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.915171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.915409] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.916435] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 606b085e-1f22-4f78-a866-0c824c54896a with status ACTIVE [ 834.916662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.916795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.916864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.917212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.917362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.917580] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.917676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.917739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.917926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.921136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.921397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.921507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.921581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.921760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.921851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.921938] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 606b085e-1f22-4f78-a866-0c824c54896a is going to be updated. [ 834.945798] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.946026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.946076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.946301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.946447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.946628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-606b085e-1f22-4f78-a866-0c824c54896a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.970071] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cb93489-ac76-4653-81c1-c5d843e02116 [ 834.970071] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.970071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.970071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.970512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.970512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.970512] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cb93489-ac76-4653-81c1-c5d843e02116 already deleted. [ 834.970512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cb93489-ac76-4653-81c1-c5d843e02116" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.001372] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.002490] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.040608] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fa580c-2432-422e-a13f-1995d2283ac0 in Status: SUCCESS [ 835.040997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.041301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.041636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.041965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.043326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.043446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.043692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.043842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.043968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.044165] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.177016] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: SUCCESS [ 835.177364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.177680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.177847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.178090] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.178226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.178307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.178504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.178589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.178687] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.236539] env[69255]: INFO networking_nsxv3.common.synchronization [req-6b7194fd-f5d9-4fe4-aa2b-70fcd8338842 req-0b7e3005-dce7-42d7-a01b-0e976e3a339b tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 835.237295] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 835.237753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.237935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.238055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.238302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.238507] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.238651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.238766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.238979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.239196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.239340] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.424115] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.504929] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.508782] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.550020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.550020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.550020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.550020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.550020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.550854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.550854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.550854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.550854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.550854] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.681296] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.742338] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.742525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.742583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.742791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.766273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.766494] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.766617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.766684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.767079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.767079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.767199] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 835.810326] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.810469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.810469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.810865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.810865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.821875] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 835.934815] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.935722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.935722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.935722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.935722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.935722] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 835.968357] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.968496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.968565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.968810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.968978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.978791] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 836.006602] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.006874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.007082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.007347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.007386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.007546] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be updated. [ 836.012098] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.012198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.012276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.012502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.012555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.012648] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 836.042728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.042995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.042995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.043195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.043332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.045866] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.046021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.046616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.046616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.046616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.055430] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48fa580c-2432-422e-a13f-1995d2283ac0: rpc.has_security_group_logging(os_id): False [ 836.057516] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 836.058247] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: IN_PROGRESS for 2s [ 836.081136] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.081136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.081136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.081441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.081441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.081687] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.081813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.081869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.082100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.082324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.082474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.082589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.082667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.082808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.082900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.083109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.083291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.083291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.083421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.083506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.083604] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fa580c-2432-422e-a13f-1995d2283ac0 is going to be created. [ 836.161953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.162271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.162271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.162644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.162775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.184225] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.198786] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fa580c-2432-422e-a13f-1995d2283ac0 in Status: IN_PROGRESS for 2s [ 836.219033] env[69255]: INFO networking_nsxv3.common.synchronization [None req-5fcbdb87-25ff-434b-a4c9-79b7c31655cb tempest-MigrationsAdminTest-1462281717 tempest-MigrationsAdminTest-1462281717-project-member] Enqueued Resource ID: 14433f3e-397b-4656-adc5-f79d602f7919 with Priority: HIGHEST for action security_group_rules [ 836.219568] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14433f3e-397b-4656-adc5-f79d602f7919 with Priority: HIGHEST for action security_group_rules [ 836.220019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14433f3e-397b-4656-adc5-f79d602f7919 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.220261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.220261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.220531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.220617] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14433f3e-397b-4656-adc5-f79d602f7919',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.381297] env[69255]: INFO networking_nsxv3.common.synchronization [None req-b2d25d93-5031-471b-9214-7cc6e2530443 tempest-MigrationsAdminTest-1462281717 tempest-MigrationsAdminTest-1462281717-project-member] Enqueued Resource ID: 14433f3e-397b-4656-adc5-f79d602f7919 with Priority: HIGHEST for action security_group_rules [ 836.382050] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14433f3e-397b-4656-adc5-f79d602f7919 with Priority: HIGHEST for action security_group_rules [ 836.383809] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14433f3e-397b-4656-adc5-f79d602f7919 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.383809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.686811] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.686811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.686811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.687202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.687884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.688076] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f8404c-0625-4de4-9522-49bae286c6f7 is going to be updated. [ 836.723628] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.723869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.723869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.724163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.724311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.736809] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: IN_PROGRESS for 2s [ 836.746352] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.746594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.746862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.746959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.747049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.747205] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14433f3e-397b-4656-adc5-f79d602f7919 already deleted. [ 836.747302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.747531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.747611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.747692] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14433f3e-397b-4656-adc5-f79d602f7919',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.270532] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.270741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.270817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.271254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.271452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.271623] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14433f3e-397b-4656-adc5-f79d602f7919 already deleted. [ 837.271768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14433f3e-397b-4656-adc5-f79d602f7919" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.832533] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 837.833009] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 837.833009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.993330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 837.993545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.993719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.993928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.994141] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.994268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.994331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.994487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.994563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.994644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.994733] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.069345] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 838.069510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.070273] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 838.070462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.073013] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073013] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.074034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.074034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.074034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.074034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.074034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.074271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.074271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.074339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.074488] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.075693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.075792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.075960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.076110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.076189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.076335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.076411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.076497] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.077258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.077374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.077496] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.077597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.077653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.077799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.077903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.078047] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.213831] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fa580c-2432-422e-a13f-1995d2283ac0 in Status: SUCCESS [ 838.214087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.501672] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.502755] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.502755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.503223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.503223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.503223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.503223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.503406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.503406] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.503494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.503540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.503683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.503757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.503895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.503991] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.576274] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.576942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.579499] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.580353] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.581507] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.750317] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: SUCCESS [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.750317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.750317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.750317] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.006322] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 839.026506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.026669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.026744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.027322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.027322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.027459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.027520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.027632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.027764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.027834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.028203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.028364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.028462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.028642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.028772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.028989] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.029126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.029227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.029465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.029604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.029744] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 839.082987] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.084309] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31: rpc.has_security_group_logging(os_id): False [ 839.085645] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.099422] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.099627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.099721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.099959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.100254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.111690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.111690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.111690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.111690] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be created. [ 839.116272] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 839.197525] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.197765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.197890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.198202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.198492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.232247] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: IN_PROGRESS for 2s [ 839.252400] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.592024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.592024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.592024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.592024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.592024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.592024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 839.592024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.592024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.592024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.592576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.592576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.592576] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be updated. [ 839.627232] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.627232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.627480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.627614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.627665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.629596] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.629818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.629818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.631032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.631032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.662071] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: IN_PROGRESS for 2s [ 839.662622] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 839.755243] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8f8404c-0625-4de4-9522-49bae286c6f7: rpc.has_security_group_logging(os_id): False [ 839.774935] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.775143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.775247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.776033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.776033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.776033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.776033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.776033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.776033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.776292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.776292] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f8404c-0625-4de4-9522-49bae286c6f7 is going to be created. [ 839.871842] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.872037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.872115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.872349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.872822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.885831] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: IN_PROGRESS for 2s [ 841.132019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 841.132019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.246619] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 841.247011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.247011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.247240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.247338] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.384016] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 841.384133] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=8 [ 841.675297] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 841.675515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.675690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.675909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.676104] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.676225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.676283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.676417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.676491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.676582] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.678213] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 841.678343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.678493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.678765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.679012] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.679151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.679268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.679410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.679473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.679521] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.749960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.750204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.904876] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: SUCCESS [ 841.904876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.181591] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.183027] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.685382] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.686874] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.189260] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.189588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.189588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.189799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.189887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.189993] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be updated. [ 843.191407] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.191523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.191523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.191682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.191868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.191982] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 843.228769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.228769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.228769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.229159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.229289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.231085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.231237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.231300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.231480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.231615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.242916] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 843.243630] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: IN_PROGRESS for 2s [ 845.148203] env[69255]: INFO networking_nsxv3.common.synchronization [req-e8ffd9b9-b480-4aeb-ac6e-a32441b9a77f req-eb2f9cd3-10bc-4443-8567-5f5f42e1c3b8 tempest-ServersWithSpecificFlavorTestJSON-1415283028 tempest-ServersWithSpecificFlavorTestJSON-1415283028-project-member] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 845.148822] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 845.149652] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.149807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.149879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.150103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.150258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.150354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.150412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.150558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.150637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.150727] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.258026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.258026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.259024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.259222] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.261113] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 845.261410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.261686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.261956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.262240] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.263023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.263023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.263023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.263023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.263023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.263023] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.456021] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.456021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.456021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.456021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.456021] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.456021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.456021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.456021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.456718] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.456718] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.456718] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.456718] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.456718] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.456718] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.456932] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.456976] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.477981] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.478271] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.478487] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.478747] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-37" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.479173] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.479439] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.479743] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.480151] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.480327] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.652669] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.653431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.653431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.653431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.679649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.680098] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.680254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.680343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.680582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.680661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.680716] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be updated. [ 845.711053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.711235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.713962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.713962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.713962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.723627] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: IN_PROGRESS for 2s [ 845.766614] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e916b5-2321-4083-a362-4d91a75f9d62: rpc.has_security_group_logging(os_id): False [ 845.767584] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.784994] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.785165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.785237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.785456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.785549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.785736] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.785832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.785904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.786110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.786216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.786482] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.786728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.786760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.786899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.786976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.787174] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.787271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.787332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.787470] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.787547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.787635] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 845.863834] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.863993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.864097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.864324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.864473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.880368] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 845.984320] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.984490] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.984749] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.984967] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.985143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.985309] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 not found, creating... [ 845.985591] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.985756] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.985887] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.986125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.986283] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.986602] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.986765] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.986886] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.987142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.987299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.987447] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 is going to be created. [ 846.023562] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.023780] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.024038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.024365] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.024999] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.025504] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.063519] env[69255]: INFO networking_nsxv3.common.synchronization [req-a8456155-d9a8-444f-9949-2f9fb92e14a2 req-00a1595f-2fc6-4663-8698-525205814466 tempest-ListImageFiltersTestJSON-574574432 tempest-ListImageFiltersTestJSON-574574432-project-member] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 846.064612] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 846.064612] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.064612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.064612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.064846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.065054] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.065054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.065182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.065244] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.066164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.066164] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.258370] env[69255]: INFO networking_nsxv3.common.synchronization [req-2e0be3c8-94f1-4d04-996a-4988db3b1087 req-8bd37bf7-2aca-43d1-8c8f-fef57355383d tempest-VolumesAdminNegativeTest-714470093 tempest-VolumesAdminNegativeTest-714470093-project-member] Enqueued Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_members [ 846.258925] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGHEST for action security_group_members [ 846.259252] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.259382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.259443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.259656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.259821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.259940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.260044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.260188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.260276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.260369] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.269746] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31: rpc.has_security_group_logging(os_id): False [ 846.288298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.288548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.288673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.288990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.289164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.289528] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.289810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.289871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.290139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.290282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.290431] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be updated. [ 846.350164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.350367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.350367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.350642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.350835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.364308] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: IN_PROGRESS for 2s [ 846.571024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.722318] env[69255]: INFO networking_nsxv3.common.synchronization [req-e8ffd9b9-b480-4aeb-ac6e-a32441b9a77f req-2a613649-99fb-4981-9a99-e28fce89cc73 service nova] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 846.722318] env[69255]: INFO networking_nsxv3.common.synchronization [req-e8ffd9b9-b480-4aeb-ac6e-a32441b9a77f req-2a613649-99fb-4981-9a99-e28fce89cc73 service nova] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 846.722318] env[69255]: INFO networking_nsxv3.common.synchronization [req-e8ffd9b9-b480-4aeb-ac6e-a32441b9a77f req-2a613649-99fb-4981-9a99-e28fce89cc73 service nova] Enqueued Resource ID: af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 with Priority: HIGHEST for action port [ 846.722318] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_rules [ 846.722318] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 846.722318] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 with Priority: HIGHEST for action port [ 846.722318] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.722318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.722318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.722318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.722318] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.723752] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.724053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.724542] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.725195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.725195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.725195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.725195] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.764409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.764409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.764409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.764728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.764728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.764826] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.764953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.765019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.765217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.765217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.765373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fa580c-2432-422e-a13f-1995d2283ac0 is going to be updated. [ 846.793172] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.793313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.793380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.793613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.793728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.803674] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fa580c-2432-422e-a13f-1995d2283ac0 in Status: IN_PROGRESS for 2s [ 847.074571] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.228341] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.228341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.228341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 with status ACTIVE [ 847.228550] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.228550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.228655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.228794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.228884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.229073] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.229172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.229322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.229382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.229467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.229717] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.229851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.229935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.230112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.230192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.230283] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4 is going to be updated. [ 847.253045] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.253208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.253280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.253497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.253893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.253893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af4b9a5b-012b-4f05-b4b9-7e0aaaba12f4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.576166] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.576448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.576448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.576718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.577043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.577043] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be updated. [ 847.604419] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.604648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.604766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.605304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.605304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.614366] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 847.736260] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 847.737245] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b deletion is rescheduled due to dependency. [ 847.737245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.737245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.737245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.737990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.737990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.737990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.739168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.739168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.739168] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.893198] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 847.893438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.893619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.893842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.893933] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.241369] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.382358] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 848.382585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.396729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.396910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.396983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.397223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.397393] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.397492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.397615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.397817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.397891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.397979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.398081] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.744513] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.816082] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fa580c-2432-422e-a13f-1995d2283ac0 in Status: SUCCESS [ 848.816424] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fa580c-2432-422e-a13f-1995d2283ac0 deletion is rescheduled due to dependency. [ 848.816527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.900242] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.900396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.900461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.900671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.900900] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.901042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.903090] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.903090] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.903090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.903090] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.247254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.247419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.247493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.247736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.247853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.247957] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be updated. [ 849.281836] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.282059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.282206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.282378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.282486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.291637] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: IN_PROGRESS for 2s [ 849.406016] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e916b5-2321-4083-a362-4d91a75f9d62: rpc.has_security_group_logging(os_id): False [ 849.425776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.426026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.426026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.426300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.426442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.426667] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.426800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.426886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.427075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.427186] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.427418] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.428036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.428036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.428036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.428036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.428036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.428307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.428307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.428444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.428759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.428759] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 849.496488] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.496666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.496790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.497056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.497172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.511524] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 849.624397] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 849.624655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.305040] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 851.305397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.305502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.305718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.305956] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.306101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.306236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.306346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.346939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.346939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.346939] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.527519] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 851.528256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.722372] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 851.722492] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 851.812831] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.314642] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f33ed09a-fe24-4b0c-9bbd-6935d7eac81b: rpc.has_security_group_logging(os_id): False [ 852.339487] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.339487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.339705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.340478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.340478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.340478] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.340478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.340478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.340703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.340703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.340797] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be updated. [ 852.425853] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.426054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.426129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.426346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.426508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.444254] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: IN_PROGRESS for 2s [ 853.307404] env[69255]: INFO networking_nsxv3.common.synchronization [req-318fa4e7-ec95-4aec-9a74-27505906eb40 req-2fa56a51-a687-427d-8309-6f62cc969b93 tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 853.307986] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 853.309018] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.309018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.309018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.309018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.309258] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.309465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.309465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.309670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.309780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.309896] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.805521] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.806011] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.806011] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.806262] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.806528] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.806751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.807010] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.807306] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.807540] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.807893] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.808040] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.808165] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.808289] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.808411] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.808524] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.808680] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.815637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.815826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.815908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.816144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.834147] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.834338] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.834565] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.834797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.835551] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-1b339a27-d510-4db3-93e8-3c8c624c1095 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.835551] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.835551] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.836097] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.836097] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b339a27-d510-4db3-93e8-3c8c624c1095',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.838987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.839226] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.839336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.839402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.840204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.840204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.840204] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 853.870180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.870340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.870387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.870591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.870762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.881205] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 854.340425] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.340566] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.340682] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.341019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.342034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.342034] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 1b339a27-d510-4db3-93e8-3c8c624c1095 not found, creating... [ 854.342034] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.342034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.342283] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.342374] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.342550] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.342866] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.343066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.343221] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.343769] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.343769] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.343916] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 1b339a27-d510-4db3-93e8-3c8c624c1095 is going to be created. [ 854.365020] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.365263] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.365411] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.365723] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.365982] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.366263] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.464417] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 854.464417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.745464] env[69255]: INFO networking_nsxv3.common.synchronization [req-318fa4e7-ec95-4aec-9a74-27505906eb40 req-7eaf515b-f21d-4c6d-987b-0ec3789e9ef2 service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 855.745464] env[69255]: INFO networking_nsxv3.common.synchronization [req-318fa4e7-ec95-4aec-9a74-27505906eb40 req-7eaf515b-f21d-4c6d-987b-0ec3789e9ef2 service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 855.745464] env[69255]: INFO networking_nsxv3.common.synchronization [req-318fa4e7-ec95-4aec-9a74-27505906eb40 req-7eaf515b-f21d-4c6d-987b-0ec3789e9ef2 service nova] Enqueued Resource ID: 1b339a27-d510-4db3-93e8-3c8c624c1095 with Priority: HIGHEST for action port [ 855.745464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 855.745464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 855.745464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b339a27-d510-4db3-93e8-3c8c624c1095 with Priority: HIGHEST for action port [ 855.749605] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.749605] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.749605] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.749605] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b339a27-d510-4db3-93e8-3c8c624c1095 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.749605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.749605] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b339a27-d510-4db3-93e8-3c8c624c1095',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.896505] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 855.896505] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.896505] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.896505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.896505] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.251694] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.251694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.251694] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b339a27-d510-4db3-93e8-3c8c624c1095 with status ACTIVE [ 856.251694] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.251849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.251876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.252107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.252202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.252388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.252493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.252556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.252707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.252787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.252971] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.253082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.253151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.253370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.253541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.253541] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b339a27-d510-4db3-93e8-3c8c624c1095 is going to be updated. [ 856.278075] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.278398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.278475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.278857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.278888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.279088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b339a27-d510-4db3-93e8-3c8c624c1095" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.398695] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.885550] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d73029d1-eb64-4a63-885c-b2ec87ebf9e3 None None] Enqueued Resource ID: df298136-3250-4b08-8001-b8840ea34acb with Priority: HIGHEST for action port [ 856.886074] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df298136-3250-4b08-8001-b8840ea34acb with Priority: HIGHEST for action port [ 856.886409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-df298136-3250-4b08-8001-b8840ea34acb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.886527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df298136-3250-4b08-8001-b8840ea34acb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.886590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df298136-3250-4b08-8001-b8840ea34acb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.886884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df298136-3250-4b08-8001-b8840ea34acb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.886981] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df298136-3250-4b08-8001-b8840ea34acb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.900880] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.394520] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df298136-3250-4b08-8001-b8840ea34acb [ 857.394520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.394520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.395026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.397338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.397338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.397338] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df298136-3250-4b08-8001-b8840ea34acb already deleted. [ 857.397338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df298136-3250-4b08-8001-b8840ea34acb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.402822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.402972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.403062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.403256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.403391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.403486] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 857.438106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.438106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.438106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.438398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.438711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.451353] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 858.891009] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ef8495cd-0ddb-4de2-8b38-219d00f324b8 None None] Enqueued Resource ID: 85a0b4e1-fb90-4a95-b5f5-81d1467df77a with Priority: HIGHEST for action port [ 858.891624] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85a0b4e1-fb90-4a95-b5f5-81d1467df77a with Priority: HIGHEST for action port [ 858.891933] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-85a0b4e1-fb90-4a95-b5f5-81d1467df77a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.892069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85a0b4e1-fb90-4a95-b5f5-81d1467df77a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.892134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85a0b4e1-fb90-4a95-b5f5-81d1467df77a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.892387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85a0b4e1-fb90-4a95-b5f5-81d1467df77a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.892465] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85a0b4e1-fb90-4a95-b5f5-81d1467df77a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.397079] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85a0b4e1-fb90-4a95-b5f5-81d1467df77a [ 859.397079] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.397656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.397656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.397656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.397656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.397777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85a0b4e1-fb90-4a95-b5f5-81d1467df77a already deleted. [ 859.397856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85a0b4e1-fb90-4a95-b5f5-81d1467df77a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.463690] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 859.464367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.464367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.464367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.464804] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.464804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.464804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.464804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.464994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.464994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.465648] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.967864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.968420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.968420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.968499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.968689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.969346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.969346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.969346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.969346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.969346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.969476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.969573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.969707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.969895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.970223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.970344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.970564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.970760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.970868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.970964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.971109] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.475090] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3: rpc.has_security_group_logging(os_id): False [ 860.500408] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.500408] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.500408] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.500408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.500984] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.500984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.500984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.500984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.500984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.501409] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 860.578025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.578025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.578025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.578025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.578025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.599312] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 861.378555] env[69255]: INFO networking_nsxv3.common.synchronization [None req-51764f43-f98d-4811-9d6a-8858c60212d3 None None] Enqueued Resource ID: 38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c with Priority: HIGHEST for action port [ 861.378555] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c with Priority: HIGHEST for action port [ 861.378555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.378555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.378555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.378555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.378555] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.882202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c [ 861.882202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.882202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.882434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.882506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.882623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.882735] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c already deleted. [ 861.882835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38dbb5fe-d2f6-4e7b-844c-cbb86bcf1c0c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.586399] env[69255]: INFO networking_nsxv3.common.synchronization [req-2847c01b-19be-491a-9ca1-513e95367d68 req-e0e4e665-621d-46af-8ec4-6d19e0b57300 tempest-ServersTestFqdnHostnames-596836303 tempest-ServersTestFqdnHostnames-596836303-project-member] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_members [ 862.586997] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGHEST for action security_group_members [ 862.588345] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.588506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.588988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.588988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.588988] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.589204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.589204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.589299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.589341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.589448] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.619782] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 862.621036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.653369] env[69255]: INFO networking_nsxv3.common.synchronization [req-105acb19-d09f-45af-8b03-0620f6018e3a req-6be84274-78d3-4dc9-ac0d-5570acb5fae4 tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 862.653912] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 862.654916] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.657604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.657714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.657937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.658493] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.658493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.658493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.658493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.659473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.659473] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.092384] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.092600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.092749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.093019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.118074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.118367] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.118500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.118566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.118760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.118837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.118924] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 is going to be updated. [ 863.146799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.148261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.148261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.148366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.148600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.164656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22e932-32d8-43d0-87bb-f6563236db76 in Status: IN_PROGRESS for 2s [ 863.164656] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.466945] env[69255]: INFO networking_nsxv3.common.synchronization [None req-09abce7d-566f-4898-99be-bd3296ec1e19 None None] Enqueued Resource ID: 9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd with Priority: HIGHEST for action port [ 863.467103] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd with Priority: HIGHEST for action port [ 863.467358] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.467476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.467544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.468255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.468255] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.667620] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.970751] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd [ 863.971061] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.971201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.971271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.971526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.971670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.971775] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd already deleted. [ 863.971867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ee02c82-ae15-4e20-9d0e-9ab4fe23cadd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.170821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.171538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.171538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.171538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.171538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.171538] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 864.239460] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.239616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.243020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.243020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.243020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.256340] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 865.184553] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b22e932-32d8-43d0-87bb-f6563236db76 in Status: SUCCESS [ 865.184938] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 deletion is rescheduled due to dependency. [ 865.184986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.269296] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 866.269296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.886066] env[69255]: INFO networking_nsxv3.common.synchronization [None req-5d75646e-bdae-4a0d-8c0b-ccd0a136fc2d None None] Enqueued Resource ID: d7648a55-ecb3-4e5c-acdd-9648f46075e2 with Priority: HIGHEST for action port [ 866.886066] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7648a55-ecb3-4e5c-acdd-9648f46075e2 with Priority: HIGHEST for action port [ 866.886066] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7648a55-ecb3-4e5c-acdd-9648f46075e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.886066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7648a55-ecb3-4e5c-acdd-9648f46075e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.886359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7648a55-ecb3-4e5c-acdd-9648f46075e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.886463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7648a55-ecb3-4e5c-acdd-9648f46075e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.886545] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7648a55-ecb3-4e5c-acdd-9648f46075e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.390899] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7648a55-ecb3-4e5c-acdd-9648f46075e2 [ 867.390899] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.390899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.391242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.391242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.391315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.391548] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7648a55-ecb3-4e5c-acdd-9648f46075e2 already deleted. [ 867.391548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7648a55-ecb3-4e5c-acdd-9648f46075e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.149926] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7af72c61-1df2-488f-947c-96b7e48fd8eb None None] Enqueued Resource ID: d9d76708-892d-4e5d-b55a-afe44b732ff1 with Priority: HIGHEST for action port [ 869.150220] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d76708-892d-4e5d-b55a-afe44b732ff1 with Priority: HIGHEST for action port [ 869.150930] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9d76708-892d-4e5d-b55a-afe44b732ff1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.151012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9d76708-892d-4e5d-b55a-afe44b732ff1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.151091] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9d76708-892d-4e5d-b55a-afe44b732ff1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.151452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9d76708-892d-4e5d-b55a-afe44b732ff1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.151452] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d76708-892d-4e5d-b55a-afe44b732ff1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.654991] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9d76708-892d-4e5d-b55a-afe44b732ff1 [ 869.655241] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.655375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.655443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.655657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.655745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.655844] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9d76708-892d-4e5d-b55a-afe44b732ff1 already deleted. [ 869.655923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9d76708-892d-4e5d-b55a-afe44b732ff1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.151252] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 874.151595] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 874.430730] env[69255]: INFO networking_nsxv3.common.synchronization [req-16d48f0e-52b1-480e-9de2-d88c0969caa3 req-08d54a5d-f297-4180-bf17-e95dd8e3050c tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 874.431452] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 874.431560] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.431707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.431771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.432124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.432311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.432816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.432816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.433999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.433999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.433999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.939654] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.939654] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.939654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.939654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 874.968375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.968375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.968375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.968375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.968375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.984343] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 875.039153] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.039153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.039153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.039789] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.040311] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.040878] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.041156] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.041955] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.043018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.043018] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.043018] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.043221] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.043537] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.045014] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.045014] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.045014] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.064767] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.065654] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.066055] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.066388] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.068859] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-52c5e51b-3cc2-448b-98d7-27baf28aec8e taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.068859] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.068859] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.068859] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.069567] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52c5e51b-3cc2-448b-98d7-27baf28aec8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.572494] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.572895] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.572895] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.573150] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.573308] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.573476] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 52c5e51b-3cc2-448b-98d7-27baf28aec8e not found, creating... [ 875.573741] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.573905] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.574038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.574270] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.574416] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.574701] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.574888] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.575118] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.575363] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.575506] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.575654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 52c5e51b-3cc2-448b-98d7-27baf28aec8e is going to be created. [ 875.597799] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.598041] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.598179] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.598466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.598709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.598940] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.092968] env[69255]: INFO networking_nsxv3.common.synchronization [req-edb773ff-190d-4655-ac3d-2c25adc6f25a req-8ce675d7-b7cd-4ba8-a384-852d3ae8e737 tempest-ServersV294TestFqdnHostnames-1174110639 tempest-ServersV294TestFqdnHostnames-1174110639-project-member] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_members [ 876.093673] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGHEST for action security_group_members [ 876.094884] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.095050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.095112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.095300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.095459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.095682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.095682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.095763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.095869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.096735] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.536726] env[69255]: INFO networking_nsxv3.common.synchronization [req-16d48f0e-52b1-480e-9de2-d88c0969caa3 req-50aec7c9-3b5f-445d-be69-5e512229f3dc service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 876.536895] env[69255]: INFO networking_nsxv3.common.synchronization [req-16d48f0e-52b1-480e-9de2-d88c0969caa3 req-50aec7c9-3b5f-445d-be69-5e512229f3dc service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 876.537053] env[69255]: INFO networking_nsxv3.common.synchronization [req-16d48f0e-52b1-480e-9de2-d88c0969caa3 req-50aec7c9-3b5f-445d-be69-5e512229f3dc service nova] Enqueued Resource ID: 52c5e51b-3cc2-448b-98d7-27baf28aec8e with Priority: HIGHEST for action port [ 876.537308] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 876.537734] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 876.537734] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c5e51b-3cc2-448b-98d7-27baf28aec8e with Priority: HIGHEST for action port [ 876.538102] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.538224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.538288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.538484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.541016] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.541016] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.541016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.541016] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-52c5e51b-3cc2-448b-98d7-27baf28aec8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.541016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.541016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.541016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.541016] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52c5e51b-3cc2-448b-98d7-27baf28aec8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.599522] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.599522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.599522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.599832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.599832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.599888] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.599970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.600034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.600194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.600273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.600361] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 is going to be updated. [ 876.633932] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.634106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.634174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.634396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.634536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.645473] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d24a10fe-fb92-4749-8ef6-b825581376a8 in Status: IN_PROGRESS for 2s [ 876.994925] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 876.995156] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 876.995304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.995486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.995723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.995929] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.996172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.996271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.996447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.996565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.996674] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.044023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52c5e51b-3cc2-448b-98d7-27baf28aec8e with status ACTIVE [ 877.044023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.044023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.044023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.044023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.044694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.044694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.044694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.044694] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52c5e51b-3cc2-448b-98d7-27baf28aec8e is going to be updated. [ 877.068292] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.068498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.068634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.068774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.068975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.069270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52c5e51b-3cc2-448b-98d7-27baf28aec8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.498656] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.973352] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7fdde02-428e-41fc-bd45-468037457c7b req-1c28ab03-0702-4888-8573-f06b2af2d719 tempest-ServerRescueTestJSON-1629852663 tempest-ServerRescueTestJSON-1629852663-project-member] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 877.973796] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 877.974547] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.974547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.974547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.974751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.974833] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.974962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.975044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.975883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.975883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.975883] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.000692] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.472053] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.472189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.472335] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.473437] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.473437] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.473437] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.473437] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.473720] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.473720] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.473871] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.474978] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.474978] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.474978] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.474978] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.474978] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.474978] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.476890] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.476992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.477075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.477250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.477346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.477529] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.477621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.477680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.477816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.477890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.477968] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 already deleted. [ 878.478641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.498312] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.498808] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.498985] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.499338] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.499658] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-bce27aa1-51eb-4bb5-803a-a08598bdb94c taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.499933] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.500029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.500619] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.500619] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce27aa1-51eb-4bb5-803a-a08598bdb94c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.505270] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.505270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.505270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.505270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.505270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.505270] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 878.572059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.572059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.572059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.572059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.572489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.582194] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 878.657076] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d24a10fe-fb92-4749-8ef6-b825581376a8 in Status: SUCCESS [ 878.657076] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 deletion is rescheduled due to dependency. [ 878.657076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.003385] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.003760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.003935] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.004377] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.004689] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.004895] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port bce27aa1-51eb-4bb5-803a-a08598bdb94c not found, creating... [ 879.005321] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.005525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.005694] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.006065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.006270] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.006683] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.006889] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.007033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.007366] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.007555] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.007751] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: bce27aa1-51eb-4bb5-803a-a08598bdb94c is going to be created. [ 879.029464] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.029807] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.030080] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.030387] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.030697] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.030946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.900267] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7fdde02-428e-41fc-bd45-468037457c7b req-904795e7-6620-40e2-9343-8228d9a1e542 service nova] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_rules [ 879.900606] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7fdde02-428e-41fc-bd45-468037457c7b req-904795e7-6620-40e2-9343-8228d9a1e542 service nova] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 879.900768] env[69255]: INFO networking_nsxv3.common.synchronization [req-b7fdde02-428e-41fc-bd45-468037457c7b req-904795e7-6620-40e2-9343-8228d9a1e542 service nova] Enqueued Resource ID: bce27aa1-51eb-4bb5-803a-a08598bdb94c with Priority: HIGHEST for action port [ 879.901468] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_rules [ 879.901613] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 879.901714] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce27aa1-51eb-4bb5-803a-a08598bdb94c with Priority: HIGHEST for action port [ 879.902010] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.902178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.902281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.902536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.903147] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.904024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.904279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.904279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.904464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.904618] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.904715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.904772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.904913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.904996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.905149] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.906972] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bce27aa1-51eb-4bb5-803a-a08598bdb94c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.907133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.907188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.907342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.907424] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce27aa1-51eb-4bb5-803a-a08598bdb94c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.404808] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.404808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.407255] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.409879] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bce27aa1-51eb-4bb5-803a-a08598bdb94c with status ACTIVE [ 880.410126] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.410261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.410320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.410521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.410726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.410788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.410884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.410936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.411105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.411169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.411456] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.411567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.411620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.411762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.411836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.411925] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bce27aa1-51eb-4bb5-803a-a08598bdb94c is going to be updated. [ 880.439371] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.439533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.439604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.439938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.440123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.440331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bce27aa1-51eb-4bb5-803a-a08598bdb94c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.596949] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 880.597226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.597349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.597580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.597777] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.597952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.598042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.598206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.598289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.598396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.598485] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.909075] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.104537] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.104776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.104776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.104967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.105153] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.105249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.105315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.105455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.105543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.105630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.105781] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.105874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.105932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.106144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.106257] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.106371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.106463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.106617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.106701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.106785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.110017] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.412999] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.412999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.412999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.413375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.413375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.413375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be created. [ 881.438357] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.438601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.438681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.438915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.439107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.452892] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: UNINITIALIZED for 2s [ 881.612490] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 981734c6-752d-40c2-ba2a-3f068cd82111: rpc.has_security_group_logging(os_id): False [ 881.633622] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.633842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.633842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.634084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.634180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.634551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.634695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.634764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.634933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.635027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.635235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.635331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.635406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.635563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.635656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.635840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.635929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.635988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.636507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.636641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.636738] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 881.703807] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.704366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.704366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.704599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.704843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.719496] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 882.515068] env[69255]: INFO networking_nsxv3.common.synchronization [req-1fbb85fc-9dbb-41c6-a3f3-23b1991219c9 req-2e7b9fdf-0082-4c00-9823-e2fd9ec4a32b tempest-MigrationsAdminTest-1462281717 tempest-MigrationsAdminTest-1462281717-project-member] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 882.515582] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 882.515922] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.515990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.516141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.516246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.516389] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.516479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.516536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.517746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.517746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.517746] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.019330] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.028159] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.028365] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.028490] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.028797] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.029064] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.029229] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.029360] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.029580] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.029729] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.033456] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.034024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.034024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.034024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.034145] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.034176] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.034397] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.054498] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.054498] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.054752] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.054789] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-902" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.055192] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.055365] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.055487] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.055849] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.056046] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d15e855-e0d9-45a0-b0f0-0d6bf30adecb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.467398] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.467398] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.467398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.467398] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.522520] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.558533] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.558781] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.558909] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.559237] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.559409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.559580] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 7d15e855-e0d9-45a0-b0f0-0d6bf30adecb not found, creating... [ 883.559858] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.560109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.560244] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.561239] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.561541] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.562573] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.562573] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.562573] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.562756] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.562828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.562971] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 7d15e855-e0d9-45a0-b0f0-0d6bf30adecb is going to be created. [ 883.587124] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.587385] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.587536] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.587865] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.588145] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.588587] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.735792] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 883.735792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.971298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.971516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.971609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.971868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.972047] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.972150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.972222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.972344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.972425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.972518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.972675] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.972777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.972834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.972958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.973108] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.973195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.973252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.973388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.973463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.973546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.973633] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.024681] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.024878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.024955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.025180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.025283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.025368] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be updated. [ 884.058850] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.059140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.059302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.059610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.059765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.070687] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: IN_PROGRESS for 2s [ 884.476231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a2ad9fb-edc6-4825-9f05-2a041fddcce1: rpc.has_security_group_logging(os_id): False [ 884.496983] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.497166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.497240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.498095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.498095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.498305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.498414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.498475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.498670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.498761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.498985] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.499127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.499233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.499454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.499828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.499828] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.499898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.499975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.503141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.503309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.503350] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be created. [ 884.509143] env[69255]: INFO networking_nsxv3.common.synchronization [req-1fbb85fc-9dbb-41c6-a3f3-23b1991219c9 req-fe58bd4c-c30c-4c7a-ab25-a5f7251e838c service nova] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_rules [ 884.509143] env[69255]: INFO networking_nsxv3.common.synchronization [req-1fbb85fc-9dbb-41c6-a3f3-23b1991219c9 req-fe58bd4c-c30c-4c7a-ab25-a5f7251e838c service nova] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 884.509143] env[69255]: INFO networking_nsxv3.common.synchronization [req-1fbb85fc-9dbb-41c6-a3f3-23b1991219c9 req-fe58bd4c-c30c-4c7a-ab25-a5f7251e838c service nova] Enqueued Resource ID: 7d15e855-e0d9-45a0-b0f0-0d6bf30adecb with Priority: HIGHEST for action port [ 884.509143] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_rules [ 884.509143] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 884.509143] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d15e855-e0d9-45a0-b0f0-0d6bf30adecb with Priority: HIGHEST for action port [ 884.509143] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.509143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.509143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.509143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.509143] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.515178] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.515178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.515178] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.515178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.515178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.515178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.515178] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d15e855-e0d9-45a0-b0f0-0d6bf30adecb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.590515] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.590948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.590948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.591099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.591402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.630635] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: IN_PROGRESS for 2s [ 885.016793] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.016793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.016793] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d15e855-e0d9-45a0-b0f0-0d6bf30adecb with status ACTIVE [ 885.017081] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.017218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.017292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.017559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.017700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.017942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.018083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.018153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.018321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.018404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.018587] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.018683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.018826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.018869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.018977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.019136] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d15e855-e0d9-45a0-b0f0-0d6bf30adecb is going to be updated. [ 885.043210] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.043409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.043409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.043593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.043726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.043877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d15e855-e0d9-45a0-b0f0-0d6bf30adecb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.246238] env[69255]: INFO networking_nsxv3.common.synchronization [req-3ea98291-d5bb-4419-9196-79d7d449f2db req-c727b8fb-bb8e-48e0-9c4a-41e81d1f08b0 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 885.246863] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 885.247136] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.247273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.247339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.247697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.247760] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.247823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.247896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.249108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.251038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.251038] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.751723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.824965] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.825186] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.825314] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.825644] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.825968] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.826226] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.826389] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.826621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.826812] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.827059] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.827176] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.827335] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.827402] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.827518] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.827690] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.827835] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.852717] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.852717] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.852922] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.853645] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-674" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.853645] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-bd7081d9-acd5-4921-a6b0-5c8c5299e768 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.853645] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.853935] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.854160] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.854248] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7081d9-acd5-4921-a6b0-5c8c5299e768',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.081400] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 886.081723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.081896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.082163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.082321] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.082398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.082465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.082621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.082744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.083457] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.256086] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.356687] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.356948] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.357052] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.357352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.357506] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.357669] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port bd7081d9-acd5-4921-a6b0-5c8c5299e768 not found, creating... [ 886.357931] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.358191] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.358333] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.358576] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.358742] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.359091] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.359308] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.359491] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.359715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.359951] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.360106] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 is going to be created. [ 886.382737] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.383251] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.383251] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.383484] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.383700] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.384034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.585519] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.643217] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 886.643442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.758880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.758880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.758880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.758880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.758880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.758880] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 886.794731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.794731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.794731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.794731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.794731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.807606] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 887.087640] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.559633] env[69255]: INFO networking_nsxv3.common.synchronization [req-3ea98291-d5bb-4419-9196-79d7d449f2db req-cfe644b7-ab9e-4f98-97f8-2c6a5531bcfd service nova] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 887.559974] env[69255]: INFO networking_nsxv3.common.synchronization [req-3ea98291-d5bb-4419-9196-79d7d449f2db req-cfe644b7-ab9e-4f98-97f8-2c6a5531bcfd service nova] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 887.560299] env[69255]: INFO networking_nsxv3.common.synchronization [req-3ea98291-d5bb-4419-9196-79d7d449f2db req-cfe644b7-ab9e-4f98-97f8-2c6a5531bcfd service nova] Enqueued Resource ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 with Priority: HIGHEST for action port [ 887.560961] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 887.561295] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 887.561759] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 with Priority: HIGHEST for action port [ 887.562316] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.562801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.563033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.563443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.563839] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.565199] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.565500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.566074] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7081d9-acd5-4921-a6b0-5c8c5299e768 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.566399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.568017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.568017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.568017] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7081d9-acd5-4921-a6b0-5c8c5299e768',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.590934] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.591228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.591339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.591528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.591619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.591807] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be updated. [ 887.627608] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.627807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.627807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.627963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.628162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.638088] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: IN_PROGRESS for 2s [ 888.073789] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.074137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.074232] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7081d9-acd5-4921-a6b0-5c8c5299e768 with status ACTIVE [ 888.074350] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.074454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.074557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.075152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.075152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.075152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.075152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.075152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.075399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.075399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.076118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.076118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.076118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.076118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.076118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.076118] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 is going to be updated. [ 888.105423] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.105494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.105526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.105707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.105842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.106088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.818520] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 888.818752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.819804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.819804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.819804] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.819804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.819804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.819804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.819804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.819804] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.324039] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.658283] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 889.658441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.658720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.659053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.659404] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.659579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.659761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.659968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.660108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.660234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.660359] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.827456] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.167029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.167029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.167708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.167708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.167708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167708] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.333953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.334277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.334277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.334550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.334678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.334785] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 890.368652] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.368870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.368966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.369238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.370313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.380748] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 890.671131] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1cc7026-1d45-4ec0-a32d-311a913b774a: rpc.has_security_group_logging(os_id): False [ 890.693674] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.693674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.693879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.693996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.719125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.719466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.719636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.719740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.719959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.720092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.720310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.720394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.720490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.720685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.720785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.720994] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.721123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.721209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.721359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.721439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.721537] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be updated. [ 890.796233] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.796421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.796459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.796659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.796813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.812529] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: IN_PROGRESS for 2s [ 892.394104] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 892.394440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.394645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.394953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.395260] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.395441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.395545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.395797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.395926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.396079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.396226] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.563149] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 892.563371] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 892.833530] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 892.834483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.898538] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.898765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.899425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.899886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.900194] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.900301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.900393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.900584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.900686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.900776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.900960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.901099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.901188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.901362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.901517] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.901635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.901699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.901846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.902081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.902155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.902240] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.328267] env[69255]: INFO networking_nsxv3.common.synchronization [req-c8b34b82-a4fd-4ef1-8793-7cfd4627840f req-7addac40-f4a0-44f1-be8d-a0a55120e6ff tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 893.329082] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 893.329337] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.329466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.329539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.329771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.329979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.331422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.331422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.331422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.331422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.331422] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.408305] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e916b5-2321-4083-a362-4d91a75f9d62: rpc.has_security_group_logging(os_id): False [ 893.438556] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.438851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.438851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.439039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.440123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.440611] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.440749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.440823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.442118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.442323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.442643] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.442779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.442842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.443067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.443137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.443400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.443518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.443570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.447130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.447308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.448912] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 893.519624] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.519820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.519820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.520103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.520274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.545577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 893.833540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.837331] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.837331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.837331] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be deleted. [ 893.877203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.877440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.877440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.877692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.877791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.877907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.019735] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.019934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.020116] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.020394] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.020662] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.020829] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.020951] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.021189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.021345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.021580] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.021670] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.021784] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.021896] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.022038] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.022182] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.022575] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.041884] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.042140] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.042372] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.042873] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-173" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.042873] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.043128] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.043227] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.043517] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.043657] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2020bae4-c3b1-468b-a01a-fdf5cd6e5a34',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.546415] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.547128] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.547128] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.547128] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.547409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.547513] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 not found, creating... [ 894.547690] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.547847] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.547968] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.548217] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.548374] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551648] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.551648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.551648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.551648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.551648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.551648] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 is going to be created. [ 894.574219] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.574556] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.574702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.575030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.575362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.575620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.549503] env[69255]: INFO networking_nsxv3.common.synchronization [req-c8b34b82-a4fd-4ef1-8793-7cfd4627840f req-6245837f-9fed-4891-a186-6173a9abfaea service nova] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_rules [ 895.549891] env[69255]: INFO networking_nsxv3.common.synchronization [req-c8b34b82-a4fd-4ef1-8793-7cfd4627840f req-6245837f-9fed-4891-a186-6173a9abfaea service nova] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 895.549891] env[69255]: INFO networking_nsxv3.common.synchronization [req-c8b34b82-a4fd-4ef1-8793-7cfd4627840f req-6245837f-9fed-4891-a186-6173a9abfaea service nova] Enqueued Resource ID: 2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 with Priority: HIGHEST for action port [ 895.553029] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_rules [ 895.553335] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 895.553543] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 with Priority: HIGHEST for action port [ 895.554703] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.557259] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.557259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.557259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.557259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.557592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.557592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.557592] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.558370] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.558839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.558839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.558839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.558839] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2020bae4-c3b1-468b-a01a-fdf5cd6e5a34',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.567973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 895.568326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.062164] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.062164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.062373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.062487] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 with status ACTIVE [ 896.062658] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.062765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.062831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.063054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.063173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.063405] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.063512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.063577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.063762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.063844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.064040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.064154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.064191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.064329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.064495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.064596] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2020bae4-c3b1-468b-a01a-fdf5cd6e5a34 is going to be updated. [ 896.103927] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.104193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.104193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.104445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.104610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.104811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2020bae4-c3b1-468b-a01a-fdf5cd6e5a34" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.569115] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.569115] env[69255]: INFO networking_nsxv3.common.synchronization [req-2f3d9add-db63-4fab-847c-0c3529e2672d req-23718c27-52aa-4eb9-9477-14366c855d52 tempest-ListImageFiltersTestJSON-574574432 tempest-ListImageFiltersTestJSON-574574432-project-member] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 896.570207] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGHEST for action security_group_members [ 896.570680] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.570955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.572036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.572383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.572650] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.572880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.573034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.573297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.573508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.573700] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.070496] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.070675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.070675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.070811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.070905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.071013] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be created. [ 897.076830] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.076989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.077091] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.077351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.077461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.077864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.077864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.078043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.078092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.078149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.078231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be updated. [ 897.080037] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 897.081368] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 897.081368] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 897.081368] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 897.081969] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.082122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.082237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.082417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.082568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.082664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.082727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.082869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.082945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.083046] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.083911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.084038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.084113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.084325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.084469] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.084565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.084627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.084790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.084870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.084956] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.098185] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.098276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.098615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.098615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.098731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.110652] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: UNINITIALIZED for 2s [ 897.111540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.111692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.111727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.111927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.112078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.122240] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: IN_PROGRESS for 2s [ 897.143178] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 897.143414] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 897.143515] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_rules [ 897.144417] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 897.144417] env[69255]: INFO networking_nsxv3.common.synchronization [req-326777ab-9e0b-4481-8be9-ac197e7a9cc0 req-25dc534e-fd12-4786-b2e7-5086b31cb48e tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 with Priority: HIGHEST for action port [ 897.145965] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 897.146176] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_rules [ 897.146284] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 with Priority: HIGHEST for action port [ 897.146370] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 897.146461] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 897.146827] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.146958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.147054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.147234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.147479] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.148642] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.151508] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.151508] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7081d9-acd5-4921-a6b0-5c8c5299e768 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.151508] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7081d9-acd5-4921-a6b0-5c8c5299e768',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.151508] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.151508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.152133] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.152133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.586592] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.587806] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.652497] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.654028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.654477] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.654705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.654956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7081d9-acd5-4921-a6b0-5c8c5299e768 with status ACTIVE [ 897.658059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.658059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.658059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.658059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.659721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.662803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.662803] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 is going to be updated. [ 897.691027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.691276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.691356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.691532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.691680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.691846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.015560] env[69255]: INFO networking_nsxv3.common.synchronization [req-98d6b57a-9afa-4e10-b7fa-1353716369ee req-a31e2cfd-9af5-464e-98e9-6477c73dd2cb tempest-ServerMetadataNegativeTestJSON-134093561 tempest-ServerMetadataNegativeTestJSON-134093561-project-member] Enqueued Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_members [ 898.016169] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_members [ 898.016483] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.017400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.017539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.017806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.018633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.018780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.018851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.019017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.019110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.019208] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.093883] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.094974] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.261220] env[69255]: INFO networking_nsxv3.common.synchronization [req-abdf7144-8a18-43c6-ad19-7861b8b4f7d8 req-2d39468c-304d-420b-8afd-10a00295014f tempest-ServersWithSpecificFlavorTestJSON-1415283028 tempest-ServersWithSpecificFlavorTestJSON-1415283028-project-member] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 898.261220] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGHEST for action security_group_members [ 898.263145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.265566] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.265566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.265566] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.363979] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.364471] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-653" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.364471] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-653" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.364653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-653" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.364941] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.365348] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.365529] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.366074] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.366279] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.366527] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.366639] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.366759] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.367342] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.367342] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.367342] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.367342] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.388419] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.388630] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 898.388788] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.388976] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-653" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.389345] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-b7927e7a-2984-4758-9cba-b616d4a87eea taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.389600] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.389774] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.390107] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.390258] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7927e7a-2984-4758-9cba-b616d4a87eea',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.522761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.523155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.523336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.523629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.523756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.524229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.524445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.524582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.524836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.524981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.525704] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d already deleted. [ 898.525704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.596885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.597212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.597212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.597353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.597444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.597539] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 898.598817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.598935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.599007] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.599183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.599265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.599356] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be created. [ 898.632201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.632399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.632472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.632731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.632964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.637962] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.638119] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.638191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.638394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.638536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.649984] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: UNINITIALIZED for 2s [ 898.650724] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 898.772437] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.772605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.772677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.772904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.772989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.773201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.773363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.773415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.773555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.773631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.773723] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be updated. [ 898.804537] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.804779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.804779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.805074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.805251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.814373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: IN_PROGRESS for 2s [ 898.893529] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.893872] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.894094] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.894490] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.894710] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.894915] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port b7927e7a-2984-4758-9cba-b616d4a87eea not found, creating... [ 898.895253] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.895457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.895771] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.896091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.896281] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.896637] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.896833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.896892] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.897129] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.897277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.897427] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: b7927e7a-2984-4758-9cba-b616d4a87eea is going to be created. [ 898.919919] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.920156] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.920295] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.920641] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.920936] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.921226] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.129153] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 899.129667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.129667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.129948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.136134] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.136622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.136622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.137245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.137245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.137245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.137245] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.151452] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a73172-9297-4dba-844d-93ad67b908a4 in Status: SUCCESS [ 899.151743] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 deletion is rescheduled due to dependency. [ 899.151913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.642346] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.642680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.642680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.642827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.642992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.645871] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.645871] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.645871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.645871] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.870468] env[69255]: INFO networking_nsxv3.common.synchronization [req-98d6b57a-9afa-4e10-b7fa-1353716369ee req-23856368-fe87-46e3-a5ca-de39d81ed01a service nova] Enqueued Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_rules [ 899.870665] env[69255]: INFO networking_nsxv3.common.synchronization [req-98d6b57a-9afa-4e10-b7fa-1353716369ee req-23856368-fe87-46e3-a5ca-de39d81ed01a service nova] Enqueued Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_members [ 899.870822] env[69255]: INFO networking_nsxv3.common.synchronization [req-98d6b57a-9afa-4e10-b7fa-1353716369ee req-23856368-fe87-46e3-a5ca-de39d81ed01a service nova] Enqueued Resource ID: b7927e7a-2984-4758-9cba-b616d4a87eea with Priority: HIGHEST for action port [ 899.873050] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_rules [ 899.873215] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_members [ 899.873490] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7927e7a-2984-4758-9cba-b616d4a87eea with Priority: HIGHEST for action port [ 899.873728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.873835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.873911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.874195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.874283] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.875232] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.875366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.875450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.875621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.875768] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.875864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.875915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.876140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.876226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.876417] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.877809] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7927e7a-2984-4758-9cba-b616d4a87eea taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.877809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.877809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.877809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.877809] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7927e7a-2984-4758-9cba-b616d4a87eea',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.147973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39f23576-868c-480d-b556-0aad9680f300: rpc.has_security_group_logging(os_id): False [ 900.172271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.172271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.172271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.172651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.172651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.172772] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.172871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.172925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.173095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.173182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.173402] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.173564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.173564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.173689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.173763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.173949] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.176126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.176496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.176496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.176496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.176737] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be created. [ 900.249838] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.249838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.249838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.249838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.249838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.264412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 900.382217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.382217] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.382217] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7927e7a-2984-4758-9cba-b616d4a87eea with status ACTIVE [ 900.382217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.382217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.382217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.382742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.382742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.382742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.382742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.382742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.382879] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7927e7a-2984-4758-9cba-b616d4a87eea is going to be updated. [ 900.411373] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.411605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.411715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.411992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.413951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.414236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7927e7a-2984-4758-9cba-b616d4a87eea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.647184] env[69255]: INFO networking_nsxv3.common.synchronization [req-04a2a258-3a98-4b15-96ab-76b5557dc50e req-235e5d87-9a1c-42d0-89e0-78f1776fc55d tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 900.648651] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 900.648651] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.648651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.648651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.648651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.648651] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.648937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.648937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.648937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.649033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.649248] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.663067] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 900.663844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.665619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.666059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.666311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.666514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.666618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.666873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.667016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.667155] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.668749] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 900.668953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.669419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.669632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.669821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.670555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.670555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.671442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.671589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.671744] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.826588] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b in Status: SUCCESS [ 900.827014] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b deletion is rescheduled due to dependency. [ 900.827014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.843906] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-810f9816-1547-4130-85e6-2435508ee9f4 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 900.844608] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 900.845060] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.845278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.845407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.846159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.846159] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.846159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.846159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.847496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.847496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.847496] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.890296] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.115950] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa796e25-3c91-4af2-b349-b1199461da2e req-f12cbcd3-6182-4cd8-aee7-1742e3ba5e5e tempest-VolumesAdminNegativeTest-714470093 tempest-VolumesAdminNegativeTest-714470093-project-member] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_members [ 901.116485] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGHEST for action security_group_members [ 901.119358] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.120064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.120064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.121448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.121448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.121448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.121448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.121691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.121691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.121691] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.152033] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.174026] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.174947] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.349609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.349806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.349806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.350242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.350242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.350443] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.350527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.350576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.350815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.350815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.351558] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 already deleted. [ 901.351558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.393375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.393593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.393593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.393818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.393918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.394011] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d is going to be created. [ 901.430726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.430936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.431052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.431318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.431554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.448248] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d in Status: UNINITIALIZED for 2s [ 901.611024] env[69255]: INFO networking_nsxv3.common.synchronization [req-1a3e1199-7f5d-4dcc-bca0-21f6e36b03cf req-a3d28c77-509c-4e10-896f-f9e456056049 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 901.611024] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 901.611024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.611024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.611024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.611024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.626745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.626745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.626745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.626745] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 is going to be updated. [ 901.654584] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.659652] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.659807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.660047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.660123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.660247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.670444] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: IN_PROGRESS for 2s [ 901.676524] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.677476] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.831464] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.831828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.831828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.832235] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.832694] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.832907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.833733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.834125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.835073] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.835606] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.835606] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.836299] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.836299] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.836299] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.836299] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.836299] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.859633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.859885] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.859994] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.860305] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.860677] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5a5c1f58-bff4-4929-9995-fd6305895db7 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.860862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.861218] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.861375] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.862575] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a5c1f58-bff4-4929-9995-fd6305895db7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.104083] env[69255]: INFO networking_nsxv3.common.synchronization [req-713abebd-aa76-4edf-89e0-511a513d15ee req-a560ef77-a545-4461-8508-65986f73c576 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 902.104083] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 902.104083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.104083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.104083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.104469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.104924] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.105047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.105112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.105419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.105419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.105510] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.116228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.116228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.116228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.116379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.116526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.117052] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.117052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.117052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.117270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.117383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.117534] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 902.155696] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.155696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.155696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.155696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.155856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.157808] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.157808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.157977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.158206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.158400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.158561] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 902.171311] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 902.179738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.179912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.180016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.180192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.180347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.180466] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 902.184781] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.184949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.185045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.185288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.185362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.186025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be updated. [ 902.237539] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.237763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.237865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.238187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.239292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.259973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 902.266430] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.270025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.270025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.270025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.270025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.274580] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.274766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.274836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.275276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.275453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.290082] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 902.296749] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: IN_PROGRESS for 2s [ 902.315237] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 902.315237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.367203] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.367414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.367550] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.367857] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.368047] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.369367] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5a5c1f58-bff4-4929-9995-fd6305895db7 not found, creating... [ 902.369367] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.369367] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.369367] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.369367] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.369367] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.369762] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.369762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.369762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.369948] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.370096] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.370282] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5a5c1f58-bff4-4929-9995-fd6305895db7 is going to be created. [ 902.398319] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.398912] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.398912] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.399281] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.399449] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.399755] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.608546] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.608726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.608767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.608988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.609342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.609565] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.609671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.609733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.609901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.609983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.610084] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 902.639242] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.639381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.639456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.639676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.640159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.653762] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 903.254491] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-66cacefb-7bd2-40a3-ba97-a90a2c241d06 service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 903.254901] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-66cacefb-7bd2-40a3-ba97-a90a2c241d06 service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 903.254901] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-66cacefb-7bd2-40a3-ba97-a90a2c241d06 service nova] Enqueued Resource ID: 5a5c1f58-bff4-4929-9995-fd6305895db7 with Priority: HIGHEST for action port [ 903.255491] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 903.255669] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 903.255775] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a5c1f58-bff4-4929-9995-fd6305895db7 with Priority: HIGHEST for action port [ 903.256683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.256683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.256683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.256683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.256683] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.257688] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.257807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.257861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.258064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.258218] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.258332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.258394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.258533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.262024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.262024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.262024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a5c1f58-bff4-4929-9995-fd6305895db7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.262024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.262024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.262024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.262024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a5c1f58-bff4-4929-9995-fd6305895db7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.470083] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d in Status: SUCCESS [ 903.470604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.471016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.471016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.471157] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.471276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.471340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.471487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.471568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.471648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.471740] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.685261] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 in Status: SUCCESS [ 903.685763] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 deletion is rescheduled due to dependency. [ 903.685950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.761872] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.762084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.762360] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.763540] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a5c1f58-bff4-4929-9995-fd6305895db7 with status ACTIVE [ 903.763817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.764009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.765521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.765618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.765817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.765918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.766168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.766251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.766438] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.766534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.766693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.766770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.766848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.766975] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a5c1f58-bff4-4929-9995-fd6305895db7 is going to be updated. [ 903.792236] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.792410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.792448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.792945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.793163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.793334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a5c1f58-bff4-4929-9995-fd6305895db7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.981161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.981161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.981161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.981398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.981913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.981913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.981913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.981913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.982128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.982128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.982281] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.982386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.982454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.982724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.982869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.982965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.983036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.983199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.983276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.983352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.983445] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.084237] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-941fddf2-28e3-4657-a320-54b68089e93c tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 904.084855] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 904.085155] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.085264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.182655] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 904.182843] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 904.182978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.269068] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.273938] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 904.273938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.300281] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 904.300555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.300755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.300967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.301549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.301549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.301549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.301734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.301734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.301800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.301912] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.310756] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 904.310972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.311167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.311382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.311571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.311688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.311754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.311902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.311982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.312081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.312175] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.471525] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 904.471741] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 904.471901] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_members [ 904.472432] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 904.472721] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 904.472861] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_members [ 904.474034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.474170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.474242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.474447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.474607] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.474773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.474842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.475013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.475707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.475822] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.476665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.476783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.476851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.477008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.477160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.477254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.477317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.477452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.477531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.477619] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.482875] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-18aee929-e21d-4da3-b3f9-608bcf0b49bb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.482989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.483072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.483309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.483450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.483573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.483617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.483731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.483809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.483890] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.487282] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d: rpc.has_security_group_logging(os_id): False [ 904.509506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.509660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.509734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.509954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.510059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.510250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.510352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.510416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.510574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.510718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.510830] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.510924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.510987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.511142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.511223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.511418] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.511512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.511572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.511713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.511789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.511881] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d is going to be created. [ 904.574452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.574606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.574677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.574900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.575106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.585966] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d in Status: IN_PROGRESS for 2s [ 904.634247] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 904.634435] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 904.634627] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_rules [ 904.634721] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_members [ 904.634856] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_rules [ 904.634983] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 904.635530] env[69255]: INFO networking_nsxv3.common.synchronization [req-adcd05cb-c059-4e54-b69a-0dded15ba5df req-9df958f4-a8a7-451e-a20b-f5a0f86aebe5 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 with Priority: HIGHEST for action port [ 904.636202] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_rules [ 904.636453] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_rules [ 904.636618] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 904.636799] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 with Priority: HIGHEST for action port [ 904.637010] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_rules [ 904.637227] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 904.637686] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_members [ 904.637686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.637894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.637948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18aee929-e21d-4da3-b3f9-608bcf0b49bb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.638085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.638147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.638474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.638518] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.646700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.646700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7081d9-acd5-4921-a6b0-5c8c5299e768 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.646700] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7081d9-acd5-4921-a6b0-5c8c5299e768',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.646700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.646700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.646700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-18aee929-e21d-4da3-b3f9-608bcf0b49bb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.646700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.671963] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 904.672312] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 904.673027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.777034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.777034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.777034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.777034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.777034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.777034] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be created. [ 904.784572] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.784572] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.784572] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.784572] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.787763] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.787944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.788102] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.788377] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.788531] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.788744] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.788866] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.788983] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.789115] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.789233] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.789346] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.789489] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.804307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.804608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.817416] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.851057] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.851739] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.062 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.851739] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.851739] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.851982] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c27b311d-3328-4215-8de5-1b86b7ae104c taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.852179] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.852288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.852669] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852820] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c27b311d-3328-4215-8de5-1b86b7ae104c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.870864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.871096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.871144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.871354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.871517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.893365] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: UNINITIALIZED for 2s [ 904.986126] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.987186] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.990663] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.143678] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-18aee929-e21d-4da3-b3f9-608bcf0b49bb taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.146068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.151085] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7081d9-acd5-4921-a6b0-5c8c5299e768 with status ACTIVE [ 905.151085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.151085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.151085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.151085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.151684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.151684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.151684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.151684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.151684] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7081d9-acd5-4921-a6b0-5c8c5299e768 is going to be updated. [ 905.184321] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.184321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.184321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.184321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.184321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.184321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7081d9-acd5-4921-a6b0-5c8c5299e768" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.319680] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f5b8858-9649-4891-ac8f-4f6a330e3a51: rpc.has_security_group_logging(os_id): False [ 905.343311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.343311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.343311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.343311] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be created. [ 905.358075] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.358306] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.358470] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.359220] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.359432] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.359642] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c27b311d-3328-4215-8de5-1b86b7ae104c not found, creating... [ 905.359966] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.360152] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.361111] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.362040] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.362344] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.362804] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.363015] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.363162] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.363452] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.363621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.363791] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c27b311d-3328-4215-8de5-1b86b7ae104c is going to be created. [ 905.391230] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.391735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.391911] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.392832] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.393163] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.394052] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.438909] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.439085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.439222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.439430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.439631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.454066] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: IN_PROGRESS for 2s [ 905.490145] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.494109] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.495155] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.992092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.992293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.992376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.992665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.992768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.992911] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 906.000942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.000942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.000942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.000942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.000942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.000942] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be updated. [ 906.001701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.001815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.001875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.002100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.002199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.002231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb is going to be created. [ 906.032022] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.032022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.032022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.032308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.033098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.043029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.043029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.043029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.043029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.043029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.043397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.043498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.043608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.043853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.044074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.053068] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb in Status: UNINITIALIZED for 2s [ 906.055999] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 906.058632] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: IN_PROGRESS for 2s [ 906.091299] env[69255]: INFO networking_nsxv3.common.synchronization [None req-3c6f769a-fe9d-47cf-a63b-5b39c0327922 None None] Enqueued Resource ID: e78b1fa7-fb75-484d-9b06-32ddf96b97ca with Priority: HIGHEST for action port [ 906.091299] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e78b1fa7-fb75-484d-9b06-32ddf96b97ca with Priority: HIGHEST for action port [ 906.091841] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e78b1fa7-fb75-484d-9b06-32ddf96b97ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.091975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e78b1fa7-fb75-484d-9b06-32ddf96b97ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.092457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e78b1fa7-fb75-484d-9b06-32ddf96b97ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.094500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e78b1fa7-fb75-484d-9b06-32ddf96b97ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.094610] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e78b1fa7-fb75-484d-9b06-32ddf96b97ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.374544] env[69255]: INFO networking_nsxv3.common.synchronization [req-307774db-a95e-4041-9f48-60da2871b381 req-7bb73dba-a37d-41d0-9d59-e7c36fbb400d tempest-AttachInterfacesV270Test-1055044839 tempest-AttachInterfacesV270Test-1055044839-project-member] Enqueued Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_members [ 906.375281] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_members [ 906.375588] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.375713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.375782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.377555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.377555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.377555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.377555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.377555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.377555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.377819] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.541675] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-36032b28-19df-4a64-a78b-6f365020b7ce service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 906.541822] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-36032b28-19df-4a64-a78b-6f365020b7ce service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 906.541968] env[69255]: INFO networking_nsxv3.common.synchronization [req-0be52c40-f051-4555-9b5f-50b4c0c19130 req-36032b28-19df-4a64-a78b-6f365020b7ce service nova] Enqueued Resource ID: c27b311d-3328-4215-8de5-1b86b7ae104c with Priority: HIGHEST for action port [ 906.542545] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 906.542704] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 906.542808] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27b311d-3328-4215-8de5-1b86b7ae104c with Priority: HIGHEST for action port [ 906.543111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.543215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.543409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.543488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.543662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c27b311d-3328-4215-8de5-1b86b7ae104c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.543811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.543811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.544079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.544130] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c27b311d-3328-4215-8de5-1b86b7ae104c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.596478] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e78b1fa7-fb75-484d-9b06-32ddf96b97ca [ 906.596711] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.596844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.596910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.597151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.597231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.597342] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e78b1fa7-fb75-484d-9b06-32ddf96b97ca already deleted. [ 906.597548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e78b1fa7-fb75-484d-9b06-32ddf96b97ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.598562] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d in Status: SUCCESS [ 906.598793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.879604] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.880671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.880843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.881302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.881702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.882232] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.882487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.882635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.882913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.883572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.883572] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 already deleted. [ 906.883572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.909028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.909028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.909028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.909028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.909028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.910256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.910584] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.957221] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.957413] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-589" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.957539] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-589" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.957877] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-589" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.958158] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.958323] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.958443] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.959028] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.959028] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.959028] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.959164] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.959257] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.959373] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.962196] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.962196] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.962196] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.981383] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.982045] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.982045] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.982045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-589" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.982713] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-033e2c52-72d9-4036-9905-df6f3b77d2cd taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.983038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.983226] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.983549] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.983701] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('033e2c52-72d9-4036-9905-df6f3b77d2cd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.049537] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c27b311d-3328-4215-8de5-1b86b7ae104c with status ACTIVE [ 907.049810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.049962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.050575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.050783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.050873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.051075] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.051172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.051233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.051376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.051517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.051620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.052475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.052475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.052475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.052475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.052475] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c27b311d-3328-4215-8de5-1b86b7ae104c is going to be updated. [ 907.074667] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.074821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.074876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.075605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.075605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.075605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c27b311d-3328-4215-8de5-1b86b7ae104c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.412670] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.413097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.413235] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.475014] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 907.475260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.475806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.476040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.476136] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.486476] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.486719] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.486900] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.487164] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.487322] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.487487] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 033e2c52-72d9-4036-9905-df6f3b77d2cd not found, creating... [ 907.488257] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.488257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.488257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.488480] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.488480] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.488784] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.488956] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.489084] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.489306] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.489463] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.490107] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 033e2c52-72d9-4036-9905-df6f3b77d2cd is going to be created. [ 907.513463] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.513699] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.513809] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.514288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.514479] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.514733] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.915632] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.983303] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.983303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.052575] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7492bd4d-d7d7-412a-a652-74c84abd6d08 None None] Enqueued Resource ID: 705cddec-5f76-4c12-9b87-ab0e46298e71 with Priority: HIGHEST for action port [ 908.052575] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705cddec-5f76-4c12-9b87-ab0e46298e71 with Priority: HIGHEST for action port [ 908.053753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-705cddec-5f76-4c12-9b87-ab0e46298e71 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.057024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-705cddec-5f76-4c12-9b87-ab0e46298e71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.057024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-705cddec-5f76-4c12-9b87-ab0e46298e71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.057024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-705cddec-5f76-4c12-9b87-ab0e46298e71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.057024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705cddec-5f76-4c12-9b87-ab0e46298e71',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.071965] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 908.072221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.072660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.072900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.073109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.073227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.073292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.073442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.073525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.073790] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.075014] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 908.075768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.075931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb in Status: SUCCESS [ 908.076111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.076783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.076783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.076783] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.077059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.077059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.077059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.077241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.077241] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.077965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.078154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.078333] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.078444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.078507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.078651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.078745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.078834] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.420710] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.420710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.420710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.420710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.420710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.420710] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 908.467342] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.467342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.467342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.467342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.467342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.470441] env[69255]: INFO networking_nsxv3.common.synchronization [req-307774db-a95e-4041-9f48-60da2871b381 req-a644f3d5-2bf8-4b1d-a1bd-2c0e960c7464 service nova] Enqueued Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_rules [ 908.470875] env[69255]: INFO networking_nsxv3.common.synchronization [req-307774db-a95e-4041-9f48-60da2871b381 req-a644f3d5-2bf8-4b1d-a1bd-2c0e960c7464 service nova] Enqueued Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_members [ 908.471178] env[69255]: INFO networking_nsxv3.common.synchronization [req-307774db-a95e-4041-9f48-60da2871b381 req-a644f3d5-2bf8-4b1d-a1bd-2c0e960c7464 service nova] Enqueued Resource ID: 033e2c52-72d9-4036-9905-df6f3b77d2cd with Priority: HIGHEST for action port [ 908.471946] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_rules [ 908.472254] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_members [ 908.472530] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 033e2c52-72d9-4036-9905-df6f3b77d2cd with Priority: HIGHEST for action port [ 908.473152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.476142] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.476142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.476142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.476142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.476142] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.488735] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-033e2c52-72d9-4036-9905-df6f3b77d2cd taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.488735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.488735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.488735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.489037] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('033e2c52-72d9-4036-9905-df6f3b77d2cd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.494358] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 908.561207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 705cddec-5f76-4c12-9b87-ab0e46298e71 [ 908.561562] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.561769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.561880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.562232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.562395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.562520] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:705cddec-5f76-4c12-9b87-ab0e46298e71 already deleted. [ 908.562666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-705cddec-5f76-4c12-9b87-ab0e46298e71" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583540] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.583540] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.583997] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.954294] env[69255]: INFO networking_nsxv3.common.synchronization [req-3421e50b-75e4-4628-b58f-671464c77d26 req-49eaf0f7-7c6a-4a8f-9f72-69183edf3778 tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 908.954808] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 908.955122] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.955250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.955316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.955518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.955678] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.955784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.955836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.955970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.958604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.958604] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.994024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.994024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.994024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 033e2c52-72d9-4036-9905-df6f3b77d2cd with status ACTIVE [ 908.994024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.994024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.994024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.994962] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.994962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.994962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.994962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.994962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.994962] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 033e2c52-72d9-4036-9905-df6f3b77d2cd is going to be updated. [ 909.027107] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.027326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.027392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.027621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.027765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.027949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-033e2c52-72d9-4036-9905-df6f3b77d2cd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.089630] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.089630] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.089630] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.461397] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.499371] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.519774] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b029493-751d-4660-bcd9-b1d3cfe81bdd req-5e42383c-326e-4498-b387-771de208df8b tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 909.519951] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b029493-751d-4660-bcd9-b1d3cfe81bdd req-5e42383c-326e-4498-b387-771de208df8b tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 909.521446] env[69255]: INFO networking_nsxv3.common.synchronization [req-5b029493-751d-4660-bcd9-b1d3cfe81bdd req-5e42383c-326e-4498-b387-771de208df8b tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_members [ 909.521446] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 909.521446] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGHEST for action security_group_members [ 909.521446] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb with Priority: HIGHEST for action security_group_members [ 909.521959] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.522103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.523203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.523311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.523521] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-18aee929-e21d-4da3-b3f9-608bcf0b49bb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.523624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.591167] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.591167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.591167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.591391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.591447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.591534] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be updated. [ 909.593365] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.593484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.593551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.593725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.593847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.593969] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb is going to be updated. [ 909.595061] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.595969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.595969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.595969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.595969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.595969] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 909.676343] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.676589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.676668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.676924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.677094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.678876] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.678992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.680152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.680402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.680605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.683961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.684163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.684232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.684650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.684833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.686824] env[69255]: INFO networking_nsxv3.common.synchronization [req-4267568c-3ecf-4931-b024-85725623ff3a req-ff78439d-6e42-47a6-a119-9472328cb9b8 tempest-ImagesOneServerNegativeTestJSON-1474858949 tempest-ImagesOneServerNegativeTestJSON-1474858949-project-member] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 909.687811] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGHEST for action security_group_members [ 909.689125] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.689288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.689386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.689629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.690314] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.690314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.690314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.690496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.690550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.690680] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.697680] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb in Status: IN_PROGRESS for 2s [ 909.698629] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 909.699311] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: IN_PROGRESS for 2s [ 909.932387] env[69255]: INFO networking_nsxv3.common.synchronization [None req-be269c2a-bbbe-4a51-acb4-43264a5ca1e7 tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_rules [ 909.932387] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_rules [ 909.932387] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.932387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.932387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.933264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.933357] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.942560] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.943735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.943735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.943735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.943890] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.944871] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.945155] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.945354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.945528] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.945780] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.945931] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.946085] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.946207] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.946344] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.946453] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.946615] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.963736] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.967135] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.967328] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.967518] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.967656] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.967973] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.968187] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.968312] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.968670] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.968820] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7993a2c-69a8-437f-bc8c-f1b7c6217c3f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.001790] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.001790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.001790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.001790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.002366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.002366] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 is going to be created. [ 910.016957] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f12b8185-04d3-4050-b821-1bb68fb8853f tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_rules [ 910.017548] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_rules [ 910.018609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.018609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.035698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.035843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.036073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.036142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.036287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.047627] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 in Status: UNINITIALIZED for 2s [ 910.196046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.196046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.196046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.196046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.196046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.196223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.196223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.196223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.196571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.196571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.196571] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be updated. [ 910.263476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.263476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.263476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.263476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.263476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.280224] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: IN_PROGRESS for 2s [ 910.459717] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.459937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.460028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.460250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.460342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.460446] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d already deleted. [ 910.460616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.461316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.461519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.461749] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.467059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.467392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.467392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.467513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.467548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.467632] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 910.474041] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.474295] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.474428] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.474706] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.474862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.475044] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port a7993a2c-69a8-437f-bc8c-f1b7c6217c3f not found, creating... [ 910.475362] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.475535] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.475660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.475891] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.476051] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.476348] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.476511] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.476633] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.476849] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.476991] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.477153] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: a7993a2c-69a8-437f-bc8c-f1b7c6217c3f is going to be created. [ 910.508379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 910.508618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.508789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.509019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.509213] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.509331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.509398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.509559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.509641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.509738] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.515753] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.516040] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.516250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.516574] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.516844] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.517375] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.521750] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.521916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.521964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.522173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.522322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.534372] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 910.986433] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.986925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.986925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.986925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.986925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.987097] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d already deleted. [ 910.987191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.014737] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.480697] env[69255]: INFO networking_nsxv3.common.synchronization [req-3421e50b-75e4-4628-b58f-671464c77d26 req-32e56565-00df-4904-8917-62c84868106f service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 911.481119] env[69255]: INFO networking_nsxv3.common.synchronization [req-3421e50b-75e4-4628-b58f-671464c77d26 req-32e56565-00df-4904-8917-62c84868106f service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 911.481160] env[69255]: INFO networking_nsxv3.common.synchronization [req-3421e50b-75e4-4628-b58f-671464c77d26 req-32e56565-00df-4904-8917-62c84868106f service nova] Enqueued Resource ID: a7993a2c-69a8-437f-bc8c-f1b7c6217c3f with Priority: HIGHEST for action port [ 911.484835] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 911.485122] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 911.485293] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7993a2c-69a8-437f-bc8c-f1b7c6217c3f with Priority: HIGHEST for action port [ 911.490071] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.490209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.490271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.490475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.490560] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.492104] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.492104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.492202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.492319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.492552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.492675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.492783] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7993a2c-69a8-437f-bc8c-f1b7c6217c3f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.517528] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.718320] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb in Status: SUCCESS [ 911.718590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.718732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.718993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.719860] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.719860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.719860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.719860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.719860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.719860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.719860] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.723854] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 911.724108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.724285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.726233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.726233] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.726233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.726406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.726491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.726577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.726691] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.728563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.728563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.728563] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.729814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.730069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.730722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.730841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.730944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.731158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.731246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.731307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.731462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.731609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.731703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.731760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.731898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.731997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.732098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.732187] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.734794] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 911.735052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.737261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.737261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.737261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.737261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.737261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.737261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.737261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.737261] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.737561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.737664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.737842] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.737911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.737979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.738150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.738247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.738337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.738435] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.740254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.740441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.740621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.740748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.740896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.745242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.746610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.746610] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.997149] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7993a2c-69a8-437f-bc8c-f1b7c6217c3f with status ACTIVE [ 911.997149] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.997149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.997149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.997149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.997149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.997149] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.997149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.997438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.997438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.997438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.998523] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.998523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.998523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.998523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.998523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.998523] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7993a2c-69a8-437f-bc8c-f1b7c6217c3f is going to be updated. [ 911.999705] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.999813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.020387] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.020549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.020620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.020855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.020962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.021080] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 912.024305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.024440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.024509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.024712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.024935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.026172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7993a2c-69a8-437f-bc8c-f1b7c6217c3f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.063749] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 in Status: SUCCESS [ 912.064050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.064276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.064501] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.064727] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.064849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.064910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.065076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.065405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.065405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.065405] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.070059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.070059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.070059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.070059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.070059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.079188] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 912.237037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.237037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.237037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.237321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.237321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.237515] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.237642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.237642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.237763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.237840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.240028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb is going to be deleted. [ 912.240028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18aee929-e21d-4da3-b3f9-608bcf0b49bb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.240444] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e916b5-2321-4083-a362-4d91a75f9d62: rpc.has_security_group_logging(os_id): False [ 912.241650] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.247640] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.248745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.248955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.248955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.249206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.249352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.249499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.249606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.249669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.249830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.249905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.249990] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be updated. [ 912.264754] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.264908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.264968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.265254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.265352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.265578] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.265681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.265739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.265893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.265970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.266203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.266300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.266360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.266799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.266799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.266799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.267035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.267035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.269949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.269949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.269949] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 912.284346] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.285046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.285046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.285046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.285046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.285046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.287441] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.287612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.290262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.290262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.290262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.299253] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: IN_PROGRESS for 2s [ 912.305130] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39f23576-868c-480d-b556-0aad9680f300 in Status: SUCCESS [ 912.305130] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39f23576-868c-480d-b556-0aad9680f300 deletion is rescheduled due to dependency. [ 912.305130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.349822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.349822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.349822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.349822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.349822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.367122] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 912.548901] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 912.549275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.549275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.549479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.549667] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.549783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.549977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.550047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.550077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.550183] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.571810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.571934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.571934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.572146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.572308] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.572401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.572464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.572604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.572690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.572783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.572929] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.573064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.573151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.573269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.573458] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.573523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.573554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.573671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.573742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.573821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.573908] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.746091] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18aee929-e21d-4da3-b3f9-608bcf0b49bb: rpc.has_security_group_logging(os_id): False [ 912.746091] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.756469] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f5b8858-9649-4891-ac8f-4f6a330e3a51: rpc.has_security_group_logging(os_id): False [ 912.770204] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.770204] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.770204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.770204] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb is going to be created. [ 912.774665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.774846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.774846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.775462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.775462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.775560] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.775786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.775786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.776302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.776302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.776302] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be updated. [ 912.800266] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/18aee929-e21d-4da3-b3f9-608bcf0b49bb], does not exist path=[/infra/domains/default/groups/18aee929-e21d-4da3-b3f9-608bcf0b49bb]."\n}' [ 912.800266] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18aee929-e21d-4da3-b3f9-608bcf0b49bb [ 912.800266] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 912.857542] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.858929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.858929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.859077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.861788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.862152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.862299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.862358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.862568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.862671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.862886] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.863041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.865196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.865791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.865791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.865791] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18aee929-e21d-4da3-b3f9-608bcf0b49bb is going to be created. [ 912.882457] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.882638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.882717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.882942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.883175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.895078] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/18aee929-e21d-4da3-b3f9-608bcf0b49bb], does not exist path=[/infra/domains/default/groups/18aee929-e21d-4da3-b3f9-608bcf0b49bb]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18aee929-e21d-4da3-b3f9-608bcf0b49bb [ 912.895390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18aee929-e21d-4da3-b3f9-608bcf0b49bb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.896020] env[69255]: Traceback (most recent call last): [ 912.896063] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 912.896063] env[69255]: return func(*args, **kwargs) [ 912.896063] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 912.896063] env[69255]: res.raise_for_status() [ 912.896063] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 912.896063] env[69255]: raise HTTPError(http_error_msg, response=self) [ 912.896063] env[69255]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18aee929-e21d-4da3-b3f9-608bcf0b49bb [ 912.896063] env[69255]: During handling of the above exception, another exception occurred: [ 912.896063] env[69255]: Traceback (most recent call last): [ 912.896285] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 912.896285] env[69255]: listener.cb(fileno) [ 912.896285] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 912.896285] env[69255]: result = function(*args, **kwargs) [ 912.896285] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 912.896285] env[69255]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 912.896285] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 912.896285] env[69255]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 912.896285] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 912.896285] env[69255]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 912.896285] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 912.896285] env[69255]: res.raise_for_status() [ 912.896285] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 912.896285] env[69255]: raise HTTPError(http_error_msg, response=self) [ 912.896285] env[69255]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/18aee929-e21d-4da3-b3f9-608bcf0b49bb [ 912.896285] env[69255]: Removing descriptor: 33 [ 912.899201] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: IN_PROGRESS for 2s [ 913.054278] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.075712] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e4f3999-c21c-4125-ba57-29d87cf22d79: rpc.has_security_group_logging(os_id): False [ 913.105792] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.105990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.105990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.106276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.106370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.106592] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.106699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.106764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.106917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.106996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.107478] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.107478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.107478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.107478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.107696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.107739] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.107818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.107878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.108022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.108099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.108186] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 is going to be created. [ 913.162661] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7355d47f-beaa-491c-9481-91198bb75155 None None] Enqueued Resource ID: d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c with Priority: HIGHEST for action port [ 913.163332] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c with Priority: HIGHEST for action port [ 913.163669] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.163864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.163864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.164323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.164419] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.247034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.247034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.247034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.247034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.247034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.248621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.249107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.249677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.250019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.250303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.250892] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 913.271662] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 in Status: IN_PROGRESS for 2s [ 913.307135] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.307135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.307135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.307135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.307135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.322560] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 913.557670] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.666334] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c [ 913.666716] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.666716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.666868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.667044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.667389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.667517] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c already deleted. [ 913.667607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4dd7ae4-4c94-4f71-a6ea-d7c832aeb78c" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.046853] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9c1c6c7a-4ddf-4cbc-9dc4-7eb543c187e3 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_rules [ 914.048475] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_rules [ 914.048930] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.048930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.049113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.049281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.049382] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.060317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.061548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.061548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.061548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.061548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.061913] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 914.094157] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 914.094573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.094573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.094734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.097438] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.097627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.097724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.097926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.098029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.098136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.098396] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.098507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.098605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.098786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.098936] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.099048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.099112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.099260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.099337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.099423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.099516] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.101324] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.101462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.101511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.104036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.104036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.113842] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 914.212897] env[69255]: INFO networking_nsxv3.common.synchronization [None req-cc10d90c-da72-475d-8d96-bec11b96baab tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_rules [ 914.213675] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_rules [ 914.214050] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.214683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.311562] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 914.311734] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 deletion is rescheduled due to dependency. [ 914.311854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.395344] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 914.395344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.395549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.395768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.395864] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.578347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.578710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.578710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.578813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.578906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.578986] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 already deleted. [ 914.579078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.579225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.579373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.579457] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.604769] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0282ecb1-21b7-414b-a78b-410dac72d851: rpc.has_security_group_logging(os_id): False [ 914.639103] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.639267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.639345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.639557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.639645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.639840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.639948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.640024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.640179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.640258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.640460] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.640680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.640680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.640769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.640800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.640998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.641171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.641171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.641294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.641370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.641454] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be created. [ 914.759650] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.759650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.759650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.759650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.759650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.773569] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 914.901957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.902151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.916262] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 in Status: SUCCESS [ 914.916495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.103646] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.104191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.104191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.104191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.104588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.104588] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 already deleted. [ 915.104588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.282746] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 in Status: SUCCESS [ 915.282986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.332014] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 915.332259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.332437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.332649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.332855] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.332979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.333080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.333398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.333997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.333997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.333997] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.460987] env[69255]: INFO networking_nsxv3.common.synchronization [None req-1bc32a76-dcd4-4113-a31d-0a2f8c659502 None None] Enqueued Resource ID: a36af145-5b94-423d-a998-0ac593cf3856 with Priority: HIGHEST for action port [ 915.461297] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36af145-5b94-423d-a998-0ac593cf3856 with Priority: HIGHEST for action port [ 915.461919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36af145-5b94-423d-a998-0ac593cf3856 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.462258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36af145-5b94-423d-a998-0ac593cf3856" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.462258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36af145-5b94-423d-a998-0ac593cf3856" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.463922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36af145-5b94-423d-a998-0ac593cf3856" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.463922] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36af145-5b94-423d-a998-0ac593cf3856',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.839560] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.839867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.839867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.840815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.840815] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.840815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.840815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.840815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.840815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.840815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.841278] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.841278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.841278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.841278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.841406] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.841560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.841601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.841780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.841822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.841887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.841972] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.970238] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a36af145-5b94-423d-a998-0ac593cf3856 [ 915.970238] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.970238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.970238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.970238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.970238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.970238] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a36af145-5b94-423d-a998-0ac593cf3856 already deleted. [ 915.970238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36af145-5b94-423d-a998-0ac593cf3856" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.124477] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 916.124734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.124923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.125172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.125368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.125588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.125685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.125831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.125894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.125980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.126079] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.344910] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e916b5-2321-4083-a362-4d91a75f9d62: rpc.has_security_group_logging(os_id): False [ 916.367679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.367870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.367926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.368132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.388410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.388670] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.388841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.388960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.389132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.389225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.389467] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.389578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.389760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.389817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.389863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.390051] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.390154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.390208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.390333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.390404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.390487] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 916.487436] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.487436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.487436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.487759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.487759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.509894] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 916.628604] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.628789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.628789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.628999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.629183] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.629286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.629351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.629503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.629589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.629677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.629822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.629912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.629971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.630780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.630780] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.630780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.630780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.630780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.630780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.630780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.630780] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.782833] env[69255]: INFO networking_nsxv3.common.synchronization [req-460f63df-798f-46fc-be89-913955e3f2a8 req-7cb9ec09-9114-402a-9366-6ba54f77a74a tempest-ServerMetadataNegativeTestJSON-134093561 tempest-ServerMetadataNegativeTestJSON-134093561-project-member] Enqueued Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_members [ 916.782833] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGHEST for action security_group_members [ 916.782833] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.783054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.783093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.783342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.783553] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.783632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.783665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.783794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.783874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.784178] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.786123] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 916.786307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.788211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.788211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.788211] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.138827] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3: rpc.has_security_group_logging(os_id): False [ 917.158729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.158930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.158972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.159203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.183486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.183486] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.184187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.184469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.185553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.185553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.185553] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.185553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.185553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.185553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.185553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.185553] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.186268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.186268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.186268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.186268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.186268] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 917.260715] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.261218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.261218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.261579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.261579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.281158] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 917.286663] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.286873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.286873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.287129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.292969] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.293135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.293236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.293480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.293659] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.293764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.293828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.294131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.294131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.294403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.294403] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.307885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.308212] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.308335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.308335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.308575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.308670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.309793] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d is going to be updated. [ 917.344436] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.344572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.344649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.344859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.345008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.362075] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d in Status: IN_PROGRESS for 2s [ 917.798899] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.799212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.799212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.799372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.799540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.799643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.799708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.799859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.799953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.800099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.800266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.800367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.800428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.800619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.800710] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.800793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.800853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.800987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.801074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.801158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.801310] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.963027] env[69255]: INFO networking_nsxv3.common.synchronization [req-6d88b4c3-999e-4c52-af64-93d2812da24c req-dddd7792-de5f-4de4-b3bf-1c31b013ca88 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 917.963843] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 917.965855] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.965855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.965855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.965855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.965855] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.966362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.966518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.966831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.967049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.967242] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.208024] env[69255]: INFO networking_nsxv3.common.synchronization [req-577ea29b-3897-4b83-82d5-db73cc2310e9 req-4ea02947-b419-4306-8d4c-7b284fb71619 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 918.208422] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 918.208646] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.208756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.305771] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0282ecb1-21b7-414b-a78b-410dac72d851: rpc.has_security_group_logging(os_id): False [ 918.325272] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.325272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.325272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.325653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.325653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.325790] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.325920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.325983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.326188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.326290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.326569] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.326703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.326790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.326995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.327125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.327378] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.327508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.327590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.327788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.327898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.328052] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 918.390982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.391345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.391345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.391345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.391492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.403707] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 918.469847] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.536255] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 918.536559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.972518] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.296725] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 919.297249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.377134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d in Status: SUCCESS [ 919.377134] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d deletion is rescheduled due to dependency. [ 919.377134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.475769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.476041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.476041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.476156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.476256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.476360] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 919.506820] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.507025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.507095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.507321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.507468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.518259] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 920.424253] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 920.424642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.908934] env[69255]: INFO networking_nsxv3.common.synchronization [None req-0d05f350-b169-461a-96c6-26ee77632b3c None None] Enqueued Resource ID: 8f776744-d514-44da-9494-e04f78924756 with Priority: HIGHEST for action port [ 920.909209] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f776744-d514-44da-9494-e04f78924756 with Priority: HIGHEST for action port [ 920.909469] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f776744-d514-44da-9494-e04f78924756 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.909590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f776744-d514-44da-9494-e04f78924756" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.909652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f776744-d514-44da-9494-e04f78924756" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.910617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f776744-d514-44da-9494-e04f78924756" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.910617] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f776744-d514-44da-9494-e04f78924756',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.413042] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f776744-d514-44da-9494-e04f78924756 [ 921.414986] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.414986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.414986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.414986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.414986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.414986] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f776744-d514-44da-9494-e04f78924756 already deleted. [ 921.414986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f776744-d514-44da-9494-e04f78924756" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.529528] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 921.529806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.529910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.530172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.531350] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.531556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.531663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.531893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.532018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.532167] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.034912] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.035131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.035227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.035444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.035537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.035729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.035826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.035904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.036070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.036149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.036236] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 922.068026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.068026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.068026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.068026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.068026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.078029] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 923.286817] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9898f4fd-edb9-4d7c-87f2-82dee09f1231 None None] Enqueued Resource ID: cdc5238c-8105-40b5-ae89-a59fffd0a117 with Priority: HIGHEST for action port [ 923.287396] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc5238c-8105-40b5-ae89-a59fffd0a117 with Priority: HIGHEST for action port [ 923.287734] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdc5238c-8105-40b5-ae89-a59fffd0a117 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.287857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdc5238c-8105-40b5-ae89-a59fffd0a117" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.287925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdc5238c-8105-40b5-ae89-a59fffd0a117" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.288240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdc5238c-8105-40b5-ae89-a59fffd0a117" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.288322] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc5238c-8105-40b5-ae89-a59fffd0a117',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.790516] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdc5238c-8105-40b5-ae89-a59fffd0a117 [ 923.790765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.790905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.790972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.791232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.791279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.791420] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdc5238c-8105-40b5-ae89-a59fffd0a117 already deleted. [ 923.791486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdc5238c-8105-40b5-ae89-a59fffd0a117" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.067986] env[69255]: INFO networking_nsxv3.common.synchronization [req-771648a6-800e-4d27-9318-face3f9420ca req-00f39ea6-0d84-4be1-a449-b3d4eafad900 tempest-AttachInterfacesV270Test-1055044839 tempest-AttachInterfacesV270Test-1055044839-project-member] Enqueued Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_members [ 924.068575] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGHEST for action security_group_members [ 924.068892] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.069044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.069115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.069343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.069504] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.069594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.069692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.069837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.069945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.070016] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.094496] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 924.094757] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 deletion is rescheduled due to dependency. [ 924.094898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.574121] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.574666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.574666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.574666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.574666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.574994] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.574994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.574994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.575233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.575233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.575358] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 is going to be updated. [ 924.604745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.604936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.605015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.605236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.606008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.620771] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 in Status: IN_PROGRESS for 2s [ 925.074070] env[69255]: INFO networking_nsxv3.common.synchronization [req-3a33678e-c004-47aa-9b30-2959ecad3b7e req-c4610b8d-48bd-43f1-8861-7b98e21ee1c3 tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 925.081388] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 925.081388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.081388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.081388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.081388] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.218558] env[69255]: INFO networking_nsxv3.common.synchronization [req-6508a8a1-15c2-49c0-82a3-75b10da37a40 req-53b7bae2-934f-4916-9ca3-03f1021d0675 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 925.219168] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 925.219470] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.219590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.219663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.219863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.220017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.220115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.220174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.220317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.220399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.220486] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.583390] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.710079] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.710362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.710437] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.710710] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.711034] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.711160] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.711322] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.711513] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.712257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.712562] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.712651] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.712772] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.712915] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.713030] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.713220] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.713296] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.723428] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.723570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.723716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.723982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.736535] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.736727] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.736848] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.737055] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.737443] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-6be3a3da-311a-4891-8821-8ef5207ce337 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.737605] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.737732] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.740101] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.740101] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be3a3da-311a-4891-8821-8ef5207ce337',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.746263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.746466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.746611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.746676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.747951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.747951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.747951] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 925.776406] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.779107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.779107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.779107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.779107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.790725] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 926.085999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.245602] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.246188] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.246404] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.246749] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.246983] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.247658] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 6be3a3da-311a-4891-8821-8ef5207ce337 not found, creating... [ 926.248147] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.248388] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.248610] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.248921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.249177] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.249498] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.249666] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.249790] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.250179] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.250355] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.250507] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 6be3a3da-311a-4891-8821-8ef5207ce337 is going to be created. [ 926.270909] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.271157] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.271290] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.271572] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.271848] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.272102] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.588942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.589216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.589216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.589443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.589443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.589536] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 926.621400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.621400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.621400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.621400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.621400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.635745] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 926.637051] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 in Status: SUCCESS [ 926.637051] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 deletion is rescheduled due to dependency. [ 926.637051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.800684] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 927.800964] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 927.801034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.820189] env[69255]: INFO networking_nsxv3.common.synchronization [req-6508a8a1-15c2-49c0-82a3-75b10da37a40 req-68377f99-e543-41d8-8b68-aede25b6931d service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 927.820189] env[69255]: INFO networking_nsxv3.common.synchronization [req-6508a8a1-15c2-49c0-82a3-75b10da37a40 req-68377f99-e543-41d8-8b68-aede25b6931d service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 927.820189] env[69255]: INFO networking_nsxv3.common.synchronization [req-6508a8a1-15c2-49c0-82a3-75b10da37a40 req-68377f99-e543-41d8-8b68-aede25b6931d service nova] Enqueued Resource ID: 6be3a3da-311a-4891-8821-8ef5207ce337 with Priority: HIGHEST for action port [ 927.820189] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 927.820189] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 927.820189] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be3a3da-311a-4891-8821-8ef5207ce337 with Priority: HIGHEST for action port [ 927.820686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.820816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.820880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.821295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.821389] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.823235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.823724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.823812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.824799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.824799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.824799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.824799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.824799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.824799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.824799] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.825348] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be3a3da-311a-4891-8821-8ef5207ce337 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.825459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.825521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.825891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.825891] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be3a3da-311a-4891-8821-8ef5207ce337',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.323993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.324815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.332020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.332020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6be3a3da-311a-4891-8821-8ef5207ce337 with status ACTIVE [ 928.332020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.332020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.332020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.332020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.332817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.332817] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6be3a3da-311a-4891-8821-8ef5207ce337 is going to be updated. [ 928.355921] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.356560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.357420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.357420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.357420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.357420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be3a3da-311a-4891-8821-8ef5207ce337" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.650629] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 928.650816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.838169] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.341012] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.341183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.341254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.341478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.341573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.341674] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 929.372243] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.372388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.372431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.372630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.372787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.382035] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 930.863327] env[69255]: INFO networking_nsxv3.common.synchronization [req-62fa55e1-4ca9-4832-b204-59ef48907ec1 req-54121b9e-546c-4e88-bb40-5d84f645950d tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 930.864322] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 930.864322] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.864322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.864322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.864524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.864628] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.864720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.865529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.865529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.865529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.866093] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.082890] env[69255]: INFO networking_nsxv3.common.synchronization [req-6f5af206-bab2-4099-9bbc-19721a428bf0 req-1e888ea4-b8bc-48f7-8918-a8cf70904249 tempest-ServerRescueTestJSON-1629852663 tempest-ServerRescueTestJSON-1629852663-project-member] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 931.082890] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 931.083033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.083145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.083203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.083421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.083606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.083742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.083828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.084059] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.084197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.084325] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.368214] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.395175] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 931.395422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.395626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.395807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.396170] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.396332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.396406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.396588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.396680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.396772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.396866] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.587421] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.871925] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.891593] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.891593] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.891858] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.894915] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.894915] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.894915] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.894915] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.894915] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.894915] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.895241] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.895887] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.895887] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.895887] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.895887] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.896087] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.896087] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.903603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.903747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.903798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.904304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.904724] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.904875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.904946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.905211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.905332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.905428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.905584] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.905695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.905756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.905919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.906307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.906720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.906720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.906720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.906720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.906877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.906914] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.919046] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.921466] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.921466] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.921466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.921466] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-adbdd501-3bdd-4626-9c98-f9402103eca2 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.921466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.921466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.921466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.921466] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adbdd501-3bdd-4626-9c98-f9402103eca2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.089429] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.374093] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.374306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.374378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.374596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.374713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.374816] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 932.408508] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.408660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.408856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.409031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.409178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.410250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 981734c6-752d-40c2-ba2a-3f068cd82111: rpc.has_security_group_logging(os_id): False [ 932.420332] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 932.424021] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.425444] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.425444] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.430351] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port adbdd501-3bdd-4626-9c98-f9402103eca2 not found, creating... [ 932.430351] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.430351] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.430351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.430965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.430965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.430965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.430965] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: adbdd501-3bdd-4626-9c98-f9402103eca2 is going to be created. [ 932.432980] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.432980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.432980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.432980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.432980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.433236] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.433236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.433236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.433349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.433395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.433941] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.433941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.433941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.433941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.433941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.437994] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.437994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.437994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.437994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.437994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.437994] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 932.459098] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.459098] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.459098] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.459098] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.459702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.460080] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.500026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.500026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.500026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.500026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.500026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.520341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 932.600203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.600203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.600203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.600203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.600203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.600203] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be updated. [ 932.644912] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.645185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.645185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.645371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.645524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.658650] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: IN_PROGRESS for 2s [ 933.226373] env[69255]: INFO networking_nsxv3.common.synchronization [req-6f5af206-bab2-4099-9bbc-19721a428bf0 req-fdd20256-b18a-47fc-a440-3def42bddf68 service nova] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_rules [ 933.226696] env[69255]: INFO networking_nsxv3.common.synchronization [req-6f5af206-bab2-4099-9bbc-19721a428bf0 req-fdd20256-b18a-47fc-a440-3def42bddf68 service nova] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 933.226843] env[69255]: INFO networking_nsxv3.common.synchronization [req-6f5af206-bab2-4099-9bbc-19721a428bf0 req-fdd20256-b18a-47fc-a440-3def42bddf68 service nova] Enqueued Resource ID: adbdd501-3bdd-4626-9c98-f9402103eca2 with Priority: HIGHEST for action port [ 933.227913] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_rules [ 933.228583] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 933.229747] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adbdd501-3bdd-4626-9c98-f9402103eca2 with Priority: HIGHEST for action port [ 933.229747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.229747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.229747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.230061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.230567] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.236482] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.236482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.236482] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-adbdd501-3bdd-4626-9c98-f9402103eca2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.236482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.236482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.236482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.236482] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adbdd501-3bdd-4626-9c98-f9402103eca2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.739467] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.739554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.739748] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adbdd501-3bdd-4626-9c98-f9402103eca2 with status ACTIVE [ 933.739914] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.740033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.740102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.740326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.740422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.740592] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.740688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.740750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.740905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.740981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.741167] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.741261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.741320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.741456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.741529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.741611] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adbdd501-3bdd-4626-9c98-f9402103eca2 is going to be updated. [ 933.764762] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.764907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.764986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.765196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.765343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.765498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adbdd501-3bdd-4626-9c98-f9402103eca2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.434085] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 934.434085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.542550] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 934.542750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.672025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 934.672025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.672025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.672401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.672576] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.672711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.672780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.672950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.673465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.673465] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.178092] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.680911] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.035403] env[69255]: INFO networking_nsxv3.common.synchronization [None req-cdff29d2-09b9-4748-8d54-50671f511422 None None] Enqueued Resource ID: 0721d2ea-d2c1-4513-b55a-b2b93a158937 with Priority: HIGHEST for action port [ 936.035483] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0721d2ea-d2c1-4513-b55a-b2b93a158937 with Priority: HIGHEST for action port [ 936.035889] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-0721d2ea-d2c1-4513-b55a-b2b93a158937 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.035889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0721d2ea-d2c1-4513-b55a-b2b93a158937" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.036035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0721d2ea-d2c1-4513-b55a-b2b93a158937" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.036258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0721d2ea-d2c1-4513-b55a-b2b93a158937" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.036339] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0721d2ea-d2c1-4513-b55a-b2b93a158937',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.183683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.183930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.184077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.184413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.184526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.184618] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be updated. [ 936.215662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.215662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.215662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.215662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.215662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.226412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: IN_PROGRESS for 2s [ 936.541190] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0721d2ea-d2c1-4513-b55a-b2b93a158937 [ 936.541190] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.541190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.541190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.541407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.541511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.541603] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0721d2ea-d2c1-4513-b55a-b2b93a158937 already deleted. [ 936.541659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0721d2ea-d2c1-4513-b55a-b2b93a158937" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.812563] env[69255]: INFO networking_nsxv3.common.synchronization [None req-04cebd89-ecff-46fa-9e93-5fa8f2dd4cff tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 936.813411] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 936.813411] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.813734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.813734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.813844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.813893] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.890541] env[69255]: INFO networking_nsxv3.common.synchronization [None req-28efdec9-4ce8-4c38-8293-ba76b9ca7398 tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 936.891089] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 936.891425] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.891544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.339661] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.339661] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 already deleted. [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.339661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.339661] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.866201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.866201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.866201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.866201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.866201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.866201] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 already deleted. [ 937.866201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.917880] env[69255]: INFO networking_nsxv3.common.synchronization [None req-3ca6e723-82b1-403c-88d8-4c82ec2fc225 None None] Enqueued Resource ID: f3f853b2-07f2-4278-885b-3f9e4d621a0f with Priority: HIGHEST for action port [ 937.919109] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3f853b2-07f2-4278-885b-3f9e4d621a0f with Priority: HIGHEST for action port [ 937.919626] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3f853b2-07f2-4278-885b-3f9e4d621a0f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.920241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3f853b2-07f2-4278-885b-3f9e4d621a0f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.920411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3f853b2-07f2-4278-885b-3f9e4d621a0f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.920742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3f853b2-07f2-4278-885b-3f9e4d621a0f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.920921] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3f853b2-07f2-4278-885b-3f9e4d621a0f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.079270] env[69255]: INFO networking_nsxv3.common.synchronization [req-2faf9d1a-f9c2-4935-943d-e9c83c7c0324 req-f35700eb-f275-49dc-b100-7f75b0f63e17 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 938.079858] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 938.080153] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.080279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.080349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.080549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.080699] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.080794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.080860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.081725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.081725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.081725] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.240835] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.240835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.240835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.241330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.241503] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.409016] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.409016] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.409016] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.409016] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.409016] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.409369] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.409369] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.409735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.410110] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.410393] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.410468] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.410595] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.410693] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.410802] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.410910] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.412117] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.424165] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3f853b2-07f2-4278-885b-3f9e4d621a0f [ 938.424165] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.424165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.424165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.424165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.424165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.424165] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3f853b2-07f2-4278-885b-3f9e4d621a0f already deleted. [ 938.424165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3f853b2-07f2-4278-885b-3f9e4d621a0f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.433509] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.433733] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.433925] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.434156] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.434598] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-505cedfc-a756-4730-9be9-12f46a7ea512 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.434734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.434853] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.435433] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.435769] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505cedfc-a756-4730-9be9-12f46a7ea512',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.585322] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.585527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.585596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.585812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.608259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.608624] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.608786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.608859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.609081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.610121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.610121] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 938.645427] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.645427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.645427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.645427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.645427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.656543] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 938.745712] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.746631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.746631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.746631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.746631] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.746631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.746631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.747114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.747114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.747114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.747114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.747408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.747408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.747408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.747743] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.747743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.747743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.748082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.748082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.748082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.748082] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.939780] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.940156] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.940332] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.940657] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.941223] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.941223] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 505cedfc-a756-4730-9be9-12f46a7ea512 not found, creating... [ 938.941354] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.941636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.941856] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.942170] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.942415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.942713] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.942954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.943106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.943523] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.943523] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.943761] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 505cedfc-a756-4730-9be9-12f46a7ea512 is going to be created. [ 938.988038] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.988038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.988252] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.988430] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.988674] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.988926] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.252286] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a2ad9fb-edc6-4825-9f05-2a041fddcce1: rpc.has_security_group_logging(os_id): False [ 939.272591] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.272786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.272786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.273199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.293219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.293391] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.293465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.293503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.293694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.293882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.294217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.294332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.294507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.294752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.294845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.295060] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.295169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.295405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.295405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.295622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.295622] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be updated. [ 939.353418] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.353597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.353635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.353830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.354010] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.368696] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: IN_PROGRESS for 2s [ 939.654653] env[69255]: INFO networking_nsxv3.common.synchronization [req-2faf9d1a-f9c2-4935-943d-e9c83c7c0324 req-e3453b0d-b3f0-4f70-8412-6c0feb81674e service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 939.654707] env[69255]: INFO networking_nsxv3.common.synchronization [req-2faf9d1a-f9c2-4935-943d-e9c83c7c0324 req-e3453b0d-b3f0-4f70-8412-6c0feb81674e service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 939.654855] env[69255]: INFO networking_nsxv3.common.synchronization [req-2faf9d1a-f9c2-4935-943d-e9c83c7c0324 req-e3453b0d-b3f0-4f70-8412-6c0feb81674e service nova] Enqueued Resource ID: 505cedfc-a756-4730-9be9-12f46a7ea512 with Priority: HIGHEST for action port [ 939.655412] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 939.655552] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 939.655653] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505cedfc-a756-4730-9be9-12f46a7ea512 with Priority: HIGHEST for action port [ 939.655950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.656129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.656232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.656483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.656599] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.657442] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.657595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.657817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-505cedfc-a756-4730-9be9-12f46a7ea512 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.657947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.658049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.658240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.658350] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505cedfc-a756-4730-9be9-12f46a7ea512',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.160226] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.160561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.160656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 505cedfc-a756-4730-9be9-12f46a7ea512 with status ACTIVE [ 940.160843] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.160951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.161024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.161234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.161322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.161530] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.161708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.162240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.162522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.162666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.162920] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.163050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.163119] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.163314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.163425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.163545] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 505cedfc-a756-4730-9be9-12f46a7ea512 is going to be updated. [ 940.185953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.186113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.186180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.186390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.186525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.186685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-505cedfc-a756-4730-9be9-12f46a7ea512" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.666137] env[69255]: INFO networking_nsxv3.common.synchronization [req-d9827df8-6267-4d39-9993-10df68ce311b req-c42249dd-53cb-4ce7-89af-db35760b5627 tempest-ServerMetadataTestJSON-883180726 tempest-ServerMetadataTestJSON-883180726-project-member] Enqueued Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_members [ 940.666137] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_members [ 940.666846] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 940.667291] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.669511] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.669511] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.669511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.669511] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.670534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.670812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.671109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.671341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.671510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.672020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.672213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.672394] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.168032] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.168402] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-849" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.170158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-849" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.170158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-849" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.170158] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.170158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.170158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.170158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.170158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.170465] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.170465] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.170538] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.170678] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.170732] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.171701] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.171701] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.172382] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.172926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.172926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.172926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.172926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.173114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.173114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.173114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.173226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.173310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.173391] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2623f063-14bb-4aff-bf17-71443391d8f7 already deleted. [ 941.173471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.175245] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.192468] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.192817] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.192895] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.193116] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-849" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.193462] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5ec551f2-fca8-4675-be05-a3dc62320536 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.193713] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.193812] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.194196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.194338] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ec551f2-fca8-4675-be05-a3dc62320536',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.382782] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 941.383182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.678418] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.697235] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.697590] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.697686] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.698045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.698267] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.698470] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5ec551f2-fca8-4675-be05-a3dc62320536 not found, creating... [ 941.698753] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.698930] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.699058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.699331] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.699498] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.699843] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.700061] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.700204] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.700519] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.700734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.700931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5ec551f2-fca8-4675-be05-a3dc62320536 is going to be created. [ 941.725339] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.726186] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.726319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.726621] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.726946] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.727174] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.182845] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.182845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.182845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.182845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.182845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.182845] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 942.214058] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.214058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.214058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.214058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.214302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.223842] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 942.597376] env[69255]: INFO networking_nsxv3.common.synchronization [req-d9827df8-6267-4d39-9993-10df68ce311b req-d8a8f10d-cebb-43a6-a83a-d96e60352555 service nova] Enqueued Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_rules [ 942.597592] env[69255]: INFO networking_nsxv3.common.synchronization [req-d9827df8-6267-4d39-9993-10df68ce311b req-d8a8f10d-cebb-43a6-a83a-d96e60352555 service nova] Enqueued Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_members [ 942.597741] env[69255]: INFO networking_nsxv3.common.synchronization [req-d9827df8-6267-4d39-9993-10df68ce311b req-d8a8f10d-cebb-43a6-a83a-d96e60352555 service nova] Enqueued Resource ID: 5ec551f2-fca8-4675-be05-a3dc62320536 with Priority: HIGHEST for action port [ 942.598378] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_rules [ 942.598524] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_members [ 942.598627] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ec551f2-fca8-4675-be05-a3dc62320536 with Priority: HIGHEST for action port [ 942.598938] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.599292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.599404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.599671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.599764] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.604034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.604034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.604034] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.604034] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ec551f2-fca8-4675-be05-a3dc62320536 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.604034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.604034] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ec551f2-fca8-4675-be05-a3dc62320536',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.107493] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.107677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.107809] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ec551f2-fca8-4675-be05-a3dc62320536 with status ACTIVE [ 943.107975] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.108104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.108175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.108427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.108516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.108689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.108806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.108876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.108983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.109067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.109263] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.109373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.109443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.109546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.109623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.109889] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ec551f2-fca8-4675-be05-a3dc62320536 is going to be updated. [ 943.116120] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.143268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.143424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.143484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.143710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.143860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.144046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ec551f2-fca8-4675-be05-a3dc62320536" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.620018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.123202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.123202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.123202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.123202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.123202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.123202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2623f063-14bb-4aff-bf17-71443391d8f7 is going to be created. [ 944.158330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.158330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.158330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.158330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.158330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.167623] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2623f063-14bb-4aff-bf17-71443391d8f7 in Status: UNINITIALIZED for 2s [ 944.251468] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.254070] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.254070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.254070] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.756959] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.757384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.757384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.757606] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.757851] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.758015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.758108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.758315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.758435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.758531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.758742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.758825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.758857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.759018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.759158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.759251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.759311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.759452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.759526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.759612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.759703] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.261840] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 945.282310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.282459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.282528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.286017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.286017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.286017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.286017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.286722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.286722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.286722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.286722] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 945.373510] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.373645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.373718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.373934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.374118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.396040] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 946.181319] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2623f063-14bb-4aff-bf17-71443391d8f7 in Status: SUCCESS [ 946.181554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.181685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.182065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.182378] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.182984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.182984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.183171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.183619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.183619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.183841] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.687274] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.688635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.688635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.688635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.688635] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.688635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.688635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.690254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.690254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.690254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.690254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.690254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.690254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.690254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.690254] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.690500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.690500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.690500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.690580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.691570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.691570] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.052164] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f3932f6-a2b7-4e94-b037-1f7a8f168b30 req-5e207be4-b499-4367-8c4a-d7197b326084 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 947.052304] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f3932f6-a2b7-4e94-b037-1f7a8f168b30 req-5e207be4-b499-4367-8c4a-d7197b326084 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 947.052470] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f3932f6-a2b7-4e94-b037-1f7a8f168b30 req-5e207be4-b499-4367-8c4a-d7197b326084 tempest-SecurityGroupsTestJSON-500390293 tempest-SecurityGroupsTestJSON-500390293-project-member] Enqueued Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_members [ 947.054520] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGHEST for action security_group_members [ 947.055491] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGHEST for action security_group_members [ 947.055611] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGHEST for action security_group_members [ 947.055913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.056065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.056421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.056421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.056540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.056607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.056660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.056807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.056888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.057257] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.057852] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.057962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.058198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.058372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.058522] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.060585] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.060585] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8f8404c-0625-4de4-9522-49bae286c6f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.060585] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.060585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.061131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.061131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.061131] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.194220] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2623f063-14bb-4aff-bf17-71443391d8f7: rpc.has_security_group_logging(os_id): False [ 947.215660] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.215854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.215923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.217318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.217472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.217731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.218217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.219130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.219417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.220134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.220250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.222038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.222038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.222038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.222038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.222392] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.222457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.222520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.222701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.222808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.222979] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2623f063-14bb-4aff-bf17-71443391d8f7 is going to be created. [ 947.307828] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.308050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.308050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.308289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.309111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.345115] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2623f063-14bb-4aff-bf17-71443391d8f7 in Status: IN_PROGRESS for 2s [ 947.399810] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ac38f7e-aace-47d1-a843-6e5819d0d35f req-ec964d93-e4ec-450c-89bd-89b4fdadbacf tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_members [ 947.400761] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_members [ 947.401809] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.401924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.401924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.402221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.402433] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.402537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.402597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.402756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.402845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.402950] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.425713] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 947.426087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.562421] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.562565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.562655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.562863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.562983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.563179] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.563287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.563340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.563494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.563563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.563654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be updated. [ 947.564798] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.564957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.565723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.565723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.569454] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.569454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.593190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.595356] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.595356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.595356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.595356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.595356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.595356] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be updated. [ 947.595356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.595614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.617691] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.617691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.617691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.617691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.618129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.621629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.621888] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.622017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.622088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.622299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.622384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.622470] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f8404c-0625-4de4-9522-49bae286c6f7 is going to be updated. [ 947.632517] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: IN_PROGRESS for 2s [ 947.636578] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.636783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.636907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.637184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.637353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.652192] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: IN_PROGRESS for 2s [ 947.653178] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.653178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.653178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.653338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.653637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.664031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: IN_PROGRESS for 2s [ 947.765153] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.765153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.765153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.765965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.766272] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.766490] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.766618] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.766902] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.767084] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.767344] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.767472] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.767589] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.767704] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.767830] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.767964] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.768097] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.794673] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.794673] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.794673] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.794786] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.795173] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.795358] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.795502] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.795836] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.798024] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.905939] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.905939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.906249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.906304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.906459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.906587] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.906681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.906745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.906887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.906958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.907052] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d already deleted. [ 947.907136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.302581] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.302907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.302907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.303545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.303545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.303545] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 not found, creating... [ 948.303761] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.303921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.304058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.304292] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.304435] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.304720] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.304926] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.305120] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.305364] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.305529] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.305722] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 is going to be created. [ 948.330715] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.330715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.330715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.330929] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.331252] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.331550] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.072187] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ac38f7e-aace-47d1-a843-6e5819d0d35f req-e54f61b7-868d-4a82-ac42-c5cda7b87f5a service nova] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_rules [ 949.072390] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ac38f7e-aace-47d1-a843-6e5819d0d35f req-e54f61b7-868d-4a82-ac42-c5cda7b87f5a service nova] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_members [ 949.072545] env[69255]: INFO networking_nsxv3.common.synchronization [req-9ac38f7e-aace-47d1-a843-6e5819d0d35f req-e54f61b7-868d-4a82-ac42-c5cda7b87f5a service nova] Enqueued Resource ID: 5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 with Priority: HIGHEST for action port [ 949.072778] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_rules [ 949.072902] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_members [ 949.073026] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 with Priority: HIGHEST for action port [ 949.073610] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.073741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.073812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.074022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.074107] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.074952] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.075069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.075143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.075311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.075458] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.075553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.075614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.075756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.075840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.075928] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.076698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.076815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.076883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.077044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.077119] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.360263] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2623f063-14bb-4aff-bf17-71443391d8f7 in Status: SUCCESS [ 949.360561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.579775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.579775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.579775] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.581582] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 with status ACTIVE [ 949.581788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.581916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.581984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.582212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.582302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.582512] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.582577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.582629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.582927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.582927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.583105] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.583157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.583187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.583317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.583394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.583478] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13 is going to be updated. [ 949.620491] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.620491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.620491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.620491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.620491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.620491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ea7354a-4494-4e6c-8cd6-5ccb74dd2a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.645049] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e916b5-2321-4083-a362-4d91a75f9d62 in Status: SUCCESS [ 949.645049] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 deletion is rescheduled due to dependency. [ 949.645374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.667652] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 in Status: SUCCESS [ 949.668363] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 deletion is rescheduled due to dependency. [ 949.668363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.676388] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8f8404c-0625-4de4-9522-49bae286c6f7 in Status: SUCCESS [ 949.676388] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8f8404c-0625-4de4-9522-49bae286c6f7 deletion is rescheduled due to dependency. [ 949.676388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.085518] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.591541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.591541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.591541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.591541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.591541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.591541] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d is going to be created. [ 950.623713] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.624222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.624362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.624622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.624843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.636205] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d in Status: UNINITIALIZED for 2s [ 950.880461] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f59c4129-d400-4f75-8df6-26d1f148a562 None None] Enqueued Resource ID: be236de3-aa3b-4124-a4e4-4c587af75ab3 with Priority: HIGHEST for action port [ 950.880927] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be236de3-aa3b-4124-a4e4-4c587af75ab3 with Priority: HIGHEST for action port [ 950.881263] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-be236de3-aa3b-4124-a4e4-4c587af75ab3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.881390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be236de3-aa3b-4124-a4e4-4c587af75ab3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.881447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be236de3-aa3b-4124-a4e4-4c587af75ab3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.881698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be236de3-aa3b-4124-a4e4-4c587af75ab3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.881777] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be236de3-aa3b-4124-a4e4-4c587af75ab3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.388420] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be236de3-aa3b-4124-a4e4-4c587af75ab3 [ 951.388654] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.388790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.388877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.389077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.389165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.389249] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be236de3-aa3b-4124-a4e4-4c587af75ab3 already deleted. [ 951.389459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be236de3-aa3b-4124-a4e4-4c587af75ab3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.361843] env[69255]: INFO networking_nsxv3.common.synchronization [req-a87fc3cf-c018-4087-92cf-f9a3793a9e06 req-b32a9f27-b5cc-4c98-a1af-8d9e3522cb18 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_members [ 952.362681] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_members [ 952.363223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.363552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.363552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.363840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.364086] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.364249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.364347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.364578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.364730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.365103] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.651044] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d in Status: SUCCESS [ 952.651294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.651467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.651690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.651961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.652131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.652201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.652368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.652452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.652538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.652630] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.867341] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.867666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.867666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.868422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.868422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.868422] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.868422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.868422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.868422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.868422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.869020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 already deleted. [ 952.869020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.904950] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.904950] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.904950] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.905459] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.905459] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.905611] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.905670] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.906489] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.906489] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.906489] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.906842] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.906842] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.906842] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.907101] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.907101] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.907256] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.933777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.934163] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.934163] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.934375] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.938549] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-d2fcc364-8c87-4907-a51f-613b586369ef taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.938873] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.938873] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.939308] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.939475] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2fcc364-8c87-4907-a51f-613b586369ef',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.154942] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.252899] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a93cfd27-a7a2-48bf-9853-4c509b2d3db2 None None] Enqueued Resource ID: bc8cea73-f77d-4a63-85bb-f7162f807350 with Priority: HIGHEST for action port [ 953.253175] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc8cea73-f77d-4a63-85bb-f7162f807350 with Priority: HIGHEST for action port [ 953.253901] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc8cea73-f77d-4a63-85bb-f7162f807350 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.254032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc8cea73-f77d-4a63-85bb-f7162f807350" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.254264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc8cea73-f77d-4a63-85bb-f7162f807350" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.254780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc8cea73-f77d-4a63-85bb-f7162f807350" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.254892] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc8cea73-f77d-4a63-85bb-f7162f807350',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.443372] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.443747] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.443747] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.444039] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.444205] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.444481] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port d2fcc364-8c87-4907-a51f-613b586369ef not found, creating... [ 953.444851] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.445072] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.445387] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.445849] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.445962] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.446931] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.447127] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.447257] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.447559] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.447725] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.447879] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: d2fcc364-8c87-4907-a51f-613b586369ef is going to be created. [ 953.469291] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.469291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.469291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.469818] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.469818] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.470022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.569070] env[69255]: INFO networking_nsxv3.common.synchronization [None req-3ac52d45-6dcd-4eaf-8a04-104979917189 None None] Enqueued Resource ID: bce48205-dd41-4021-8f83-1283663fd0b4 with Priority: HIGHEST for action port [ 953.571166] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce48205-dd41-4021-8f83-1283663fd0b4 with Priority: HIGHEST for action port [ 953.571166] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bce48205-dd41-4021-8f83-1283663fd0b4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.571166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bce48205-dd41-4021-8f83-1283663fd0b4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.571166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bce48205-dd41-4021-8f83-1283663fd0b4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.571166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bce48205-dd41-4021-8f83-1283663fd0b4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.571166] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce48205-dd41-4021-8f83-1283663fd0b4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.660228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0264584e-0080-46af-9c89-3cb2fcd0c26d: rpc.has_security_group_logging(os_id): False [ 953.679202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.679538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.679698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.681051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.681051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.681051] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.681051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.681051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.681051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.681051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.681319] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d is going to be created. [ 953.739751] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.739751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.739930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.740052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.740327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.751784] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d in Status: IN_PROGRESS for 2s [ 953.759639] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc8cea73-f77d-4a63-85bb-f7162f807350 [ 953.760030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.760130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.760362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.760595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.760632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.760777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc8cea73-f77d-4a63-85bb-f7162f807350 already deleted. [ 953.760825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc8cea73-f77d-4a63-85bb-f7162f807350" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.073357] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bce48205-dd41-4021-8f83-1283663fd0b4 [ 954.073602] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.073745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.073815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.074049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.074143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.074238] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bce48205-dd41-4021-8f83-1283663fd0b4 already deleted. [ 954.074329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bce48205-dd41-4021-8f83-1283663fd0b4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.352366] env[69255]: INFO networking_nsxv3.common.synchronization [req-a87fc3cf-c018-4087-92cf-f9a3793a9e06 req-b6ed0912-5d19-4fb9-9432-d6b09f08246e service nova] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_rules [ 954.352366] env[69255]: INFO networking_nsxv3.common.synchronization [req-a87fc3cf-c018-4087-92cf-f9a3793a9e06 req-b6ed0912-5d19-4fb9-9432-d6b09f08246e service nova] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_members [ 954.352366] env[69255]: INFO networking_nsxv3.common.synchronization [req-a87fc3cf-c018-4087-92cf-f9a3793a9e06 req-b6ed0912-5d19-4fb9-9432-d6b09f08246e service nova] Enqueued Resource ID: d2fcc364-8c87-4907-a51f-613b586369ef with Priority: HIGHEST for action port [ 954.354044] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_rules [ 954.357170] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_members [ 954.357384] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2fcc364-8c87-4907-a51f-613b586369ef with Priority: HIGHEST for action port [ 954.357801] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.357968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.358073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.358339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.358453] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.360474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.360633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.360733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.361033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.361253] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.361428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.361540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.361777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.361911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.362067] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.364680] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2fcc364-8c87-4907-a51f-613b586369ef taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.364837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.364906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.368938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.368938] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2fcc364-8c87-4907-a51f-613b586369ef',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.865344] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.868583] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2fcc364-8c87-4907-a51f-613b586369ef with status ACTIVE [ 954.868583] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.868583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.868583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.868753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.869373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.869373] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.869373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.869373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.869373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.869373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.869639] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.869935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.869935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.869935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.870105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.870105] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2fcc364-8c87-4907-a51f-613b586369ef is going to be updated. [ 954.871773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.871896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.898370] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.898586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.898586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.898814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.898913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.899128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2fcc364-8c87-4907-a51f-613b586369ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.326272] env[69255]: INFO networking_nsxv3.common.synchronization [req-4802cd67-0eba-450d-bcd6-27a67d5ebb38 req-42264d0c-1fc1-49f3-b9d5-21033b11a996 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 955.327139] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 955.328159] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.328296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.328362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.328570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.328856] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.328970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.329044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.329200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.329296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.329390] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.373047] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.766826] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d in Status: SUCCESS [ 955.767108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.834509] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.835473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.835473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.835473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.835626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.835986] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.836220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.836371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.836639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.836786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.836920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 955.864928] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.866068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.866068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.866068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.866068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.875825] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 955.878146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.878291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.878330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.878534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.878626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.878731] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 is going to be created. [ 955.901345] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.901345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.901483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.901576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.901777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.917279] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: UNINITIALIZED for 2s [ 956.386658] env[69255]: INFO networking_nsxv3.common.synchronization [None req-458133a5-4149-49ff-b48f-bfed4b87a17e None None] Enqueued Resource ID: a0414780-fdab-4035-a9b4-7a2ac12d9716 with Priority: HIGHEST for action port [ 956.386658] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0414780-fdab-4035-a9b4-7a2ac12d9716 with Priority: HIGHEST for action port [ 956.387468] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0414780-fdab-4035-a9b4-7a2ac12d9716 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.387468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0414780-fdab-4035-a9b4-7a2ac12d9716" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.387468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0414780-fdab-4035-a9b4-7a2ac12d9716" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.387657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0414780-fdab-4035-a9b4-7a2ac12d9716" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.387657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0414780-fdab-4035-a9b4-7a2ac12d9716',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.890794] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0414780-fdab-4035-a9b4-7a2ac12d9716 [ 956.890794] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.890794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.890794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.890794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.890794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.890794] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0414780-fdab-4035-a9b4-7a2ac12d9716 already deleted. [ 956.890794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0414780-fdab-4035-a9b4-7a2ac12d9716" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.215329] env[69255]: INFO networking_nsxv3.common.synchronization [None req-98157cf6-de0a-4832-a9d5-4fb3bca1aa32 None None] Enqueued Resource ID: 53113981-684e-41ae-9203-bfeada63be39 with Priority: HIGHEST for action port [ 957.215742] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53113981-684e-41ae-9203-bfeada63be39 with Priority: HIGHEST for action port [ 957.216244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-53113981-684e-41ae-9203-bfeada63be39 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.216410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53113981-684e-41ae-9203-bfeada63be39" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.216488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53113981-684e-41ae-9203-bfeada63be39" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.216752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53113981-684e-41ae-9203-bfeada63be39" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.216837] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53113981-684e-41ae-9203-bfeada63be39',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.703018] env[69255]: INFO networking_nsxv3.common.synchronization [req-87634a37-0b08-410c-bd86-b3da0c447b2a req-eeac1053-1042-479d-a6a5-f9137fc077df tempest-ServerMetadataTestJSON-883180726 tempest-ServerMetadataTestJSON-883180726-project-member] Enqueued Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_members [ 957.703018] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGHEST for action security_group_members [ 957.703018] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.703018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.703018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.703018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.703018] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.703018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.703018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.703018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.705445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.705719] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.720896] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53113981-684e-41ae-9203-bfeada63be39 [ 957.720979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.721126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.721190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.721405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.721491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.721587] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53113981-684e-41ae-9203-bfeada63be39 already deleted. [ 957.723231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53113981-684e-41ae-9203-bfeada63be39" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.888577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 957.888929] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 957.888929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.928202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: SUCCESS [ 957.928621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.928673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.929084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.929414] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.929494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.929533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.929718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.929823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.929930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.930053] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.211184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.211184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.211184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.211184] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2623f063-14bb-4aff-bf17-71443391d8f7 is going to be updated. [ 958.251853] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.251853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.251853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.251853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.251853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.259572] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2623f063-14bb-4aff-bf17-71443391d8f7 in Status: IN_PROGRESS for 2s [ 958.433149] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.935305] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd8fc5f6-8c57-4558-8b42-ae2373cea267: rpc.has_security_group_logging(os_id): False [ 958.961135] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.961930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.961930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.961930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.961930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.961930] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.961930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.962294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.962294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.962294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.962407] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 is going to be created. [ 959.023507] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.023685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.023756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.023969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.024173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.039189] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: IN_PROGRESS for 2s [ 959.593322] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9be7df45-6e9e-4df9-becc-1cbcf9c2c568 None None] Enqueued Resource ID: 03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0 with Priority: HIGHEST for action port [ 959.593322] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0 with Priority: HIGHEST for action port [ 959.594435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.594435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.594435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.594435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.594435] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.098207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0 [ 960.098207] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.098207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.098207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.098207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.098207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.098207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0 already deleted. [ 960.098207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03aa1fec-c3d2-4551-a90f-5fd9f1fa74e0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.271310] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2623f063-14bb-4aff-bf17-71443391d8f7 in Status: SUCCESS [ 960.271505] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2623f063-14bb-4aff-bf17-71443391d8f7 deletion is rescheduled due to dependency. [ 960.272668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.058018] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: SUCCESS [ 961.058018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.195498] env[69255]: INFO networking_nsxv3.common.synchronization [req-eea77da3-49a2-441b-89e3-81c7f8f06271 req-02b92420-411a-4c63-ae62-8db233f37494 tempest-InstanceActionsV221TestJSON-106524551 tempest-InstanceActionsV221TestJSON-106524551-project-member] Enqueued Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_members [ 961.196308] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_members [ 961.196533] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.196695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.196787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.197111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.197314] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.197419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.197498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.197713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.197802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.197963] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.511548] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.511757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-822" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.511890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-822" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.512344] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-822" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.512613] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.512777] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.512900] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.513145] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.513289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.513506] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.513638] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.513764] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.513878] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.513994] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.514120] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.514256] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.542110] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.542332] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.542481] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.542673] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-822" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.543032] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-4dc52adf-a67c-433e-b411-e44b7486d80a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.543221] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.543345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.543854] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.544076] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc52adf-a67c-433e-b411-e44b7486d80a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.700026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.700194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.700269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.700485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.700576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.700769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.700912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.700991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.701162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.701259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.701326] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dcc0af-a718-4357-b117-90efbb3d6bec already deleted. [ 961.701406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.046439] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.046673] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.046840] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.047149] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.047636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.047914] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 4dc52adf-a67c-433e-b411-e44b7486d80a not found, creating... [ 962.048306] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.048404] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.048521] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.048770] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.048920] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.049254] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.049396] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.049578] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.049737] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.049880] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.050489] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 4dc52adf-a67c-433e-b411-e44b7486d80a is going to be created. [ 962.074164] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.074277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.074417] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.074712] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.074958] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.075208] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.639311] env[69255]: INFO networking_nsxv3.common.synchronization [req-2e4c0b92-d8ce-49b7-9f5f-476771f0265e req-4fb98c7b-9715-4373-8508-25c45d6da943 tempest-ServerRescueTestJSON-1629852663 tempest-ServerRescueTestJSON-1629852663-project-member] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 962.643193] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 962.644029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.644789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.644901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.645155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.645979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.646142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.646236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.646437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.646759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.648375] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.841083] env[69255]: INFO networking_nsxv3.common.synchronization [req-eea77da3-49a2-441b-89e3-81c7f8f06271 req-6c9fc572-aa2e-4c92-b79a-47e6a89877c8 service nova] Enqueued Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_rules [ 962.842168] env[69255]: INFO networking_nsxv3.common.synchronization [req-eea77da3-49a2-441b-89e3-81c7f8f06271 req-6c9fc572-aa2e-4c92-b79a-47e6a89877c8 service nova] Enqueued Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_members [ 962.842168] env[69255]: INFO networking_nsxv3.common.synchronization [req-eea77da3-49a2-441b-89e3-81c7f8f06271 req-6c9fc572-aa2e-4c92-b79a-47e6a89877c8 service nova] Enqueued Resource ID: 4dc52adf-a67c-433e-b411-e44b7486d80a with Priority: HIGHEST for action port [ 962.842168] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_rules [ 962.842168] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_members [ 962.842168] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc52adf-a67c-433e-b411-e44b7486d80a with Priority: HIGHEST for action port [ 962.842562] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.842562] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.842701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.845391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.845391] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.845391] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.845391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.845391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.845391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.845587] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.845587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.845587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.845798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.845882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.846172] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.846967] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dc52adf-a67c-433e-b411-e44b7486d80a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.847131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.847164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.847349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.847424] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc52adf-a67c-433e-b411-e44b7486d80a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.150796] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.348750] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.349835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.349954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.350151] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dc52adf-a67c-433e-b411-e44b7486d80a with status ACTIVE [ 963.350344] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.350454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.350566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.350735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.350827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.350994] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.351126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.351188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.351341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.351419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.351597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.351689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.351749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.351888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.351960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.356186] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dc52adf-a67c-433e-b411-e44b7486d80a is going to be updated. [ 963.377291] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.377440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.377514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.377727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.377873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.378110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dc52adf-a67c-433e-b411-e44b7486d80a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.654417] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.858413] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.159235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.159235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.159235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.159235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.159235] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.159235] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be updated. [ 964.188329] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.188499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.188553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.188805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.189244] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.199054] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: IN_PROGRESS for 2s [ 964.363926] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.364113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.364189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.364386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.364471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.364565] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dcc0af-a718-4357-b117-90efbb3d6bec is going to be created. [ 964.391748] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.392131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.392220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.392482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.392794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.403896] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dcc0af-a718-4357-b117-90efbb3d6bec in Status: UNINITIALIZED for 2s [ 966.209176] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 966.209697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.413665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dcc0af-a718-4357-b117-90efbb3d6bec in Status: SUCCESS [ 966.413854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.414032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.414290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.414478] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.414595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.414661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.414866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.414950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.415044] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.415137] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.919276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.919276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.919276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.919276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.919276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.920018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.920018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.920018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.920018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.920018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.336297] env[69255]: INFO networking_nsxv3.common.synchronization [req-92552153-3805-4cfd-b8bd-9de0bafc6495 req-3d19c599-56ef-4e6c-a7b2-a377ef18647d tempest-ServersAdminTestJSON-1831099519 tempest-ServersAdminTestJSON-1831099519-project-member] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 967.336297] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGHEST for action security_group_members [ 967.339747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.339747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.339747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.339747] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.422421] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1dcc0af-a718-4357-b117-90efbb3d6bec: rpc.has_security_group_logging(os_id): False [ 967.441686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.442024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.442024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.442274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.442386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.442627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.442753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.442821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.442985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.443087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.443288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.443373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.443432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.443610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.443689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.443995] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.444123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.444204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.444413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.444500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.444608] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1dcc0af-a718-4357-b117-90efbb3d6bec is going to be created. [ 967.524430] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.524430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.524430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.524430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.524430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.538157] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1dcc0af-a718-4357-b117-90efbb3d6bec in Status: IN_PROGRESS for 2s [ 967.630157] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ed02fbe4-7c9c-4001-9ede-1106868ea8e8 None None] Enqueued Resource ID: 7d76112e-2c2b-4efa-bbd2-c9842e0a3e97 with Priority: HIGHEST for action port [ 967.630827] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d76112e-2c2b-4efa-bbd2-c9842e0a3e97 with Priority: HIGHEST for action port [ 967.632889] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d76112e-2c2b-4efa-bbd2-c9842e0a3e97 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.633652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d76112e-2c2b-4efa-bbd2-c9842e0a3e97" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.633652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d76112e-2c2b-4efa-bbd2-c9842e0a3e97" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.633864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d76112e-2c2b-4efa-bbd2-c9842e0a3e97" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.633864] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d76112e-2c2b-4efa-bbd2-c9842e0a3e97',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.843282] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.843556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.843678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.844042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.870423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.870423] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.870423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.870423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.870423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.870423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.870423] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be updated. [ 967.902750] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.903855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.903963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.904209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.904449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.914413] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: IN_PROGRESS for 2s [ 968.138863] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d76112e-2c2b-4efa-bbd2-c9842e0a3e97 [ 968.138863] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.138863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.138863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.138863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.138863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.138863] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d76112e-2c2b-4efa-bbd2-c9842e0a3e97 already deleted. [ 968.138863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d76112e-2c2b-4efa-bbd2-c9842e0a3e97" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.555677] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1dcc0af-a718-4357-b117-90efbb3d6bec in Status: SUCCESS [ 969.555924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.597886] env[69255]: INFO networking_nsxv3.common.synchronization [None req-05627eb5-cee3-4db3-be37-eb138e9225ca None None] Enqueued Resource ID: ebad0f19-76bb-4224-bd71-60b63910f87d with Priority: HIGHEST for action port [ 969.598614] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebad0f19-76bb-4224-bd71-60b63910f87d with Priority: HIGHEST for action port [ 969.599046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebad0f19-76bb-4224-bd71-60b63910f87d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.599145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebad0f19-76bb-4224-bd71-60b63910f87d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.599205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebad0f19-76bb-4224-bd71-60b63910f87d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.599536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebad0f19-76bb-4224-bd71-60b63910f87d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.599677] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebad0f19-76bb-4224-bd71-60b63910f87d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.624863] env[69255]: INFO networking_nsxv3.common.synchronization [req-1247527e-66f9-40fa-9df7-4b86b678980a req-d25f2067-c252-40ec-93b6-ab4c4b3200b3 tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_members [ 969.625686] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGHEST for action security_group_members [ 969.626142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.626309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.626389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.626594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.626764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.627207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.627207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.627207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.627330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.627330] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.943994] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 in Status: SUCCESS [ 969.944428] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 deletion is rescheduled due to dependency. [ 969.944428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.107019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebad0f19-76bb-4224-bd71-60b63910f87d [ 970.107698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.107988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.108166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.108493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.109166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.109464] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebad0f19-76bb-4224-bd71-60b63910f87d already deleted. [ 970.109643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebad0f19-76bb-4224-bd71-60b63910f87d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.132524] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.132689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.133228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.133228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.155236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.155506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.155698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.155815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.156176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.156336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.156488] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 is going to be updated. [ 970.186046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.186046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.186046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.186046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.186046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.198221] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 in Status: IN_PROGRESS for 2s [ 970.316572] env[69255]: INFO networking_nsxv3.common.synchronization [req-99367d87-fb77-4b83-89a0-b2e9b51601df req-18cab231-973e-4074-b51e-b1837e2410f5 tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 970.317127] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 970.318019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.318019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.318019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.318019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.318019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.318427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.318427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.318527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.318609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.318724] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.820688] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.821114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.821114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.821218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.821256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.821451] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.821551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.821633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.821792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.821871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.821960] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 970.849301] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.849535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.849535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.849716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.849866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.860074] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 972.208559] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 in Status: SUCCESS [ 972.208559] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 deletion is rescheduled due to dependency. [ 972.208559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.870583] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 972.870747] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 972.871108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.436988] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.437330] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.437418] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.437720] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.438039] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.438274] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.438452] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.438737] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.438930] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.439212] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.439359] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.439520] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.439672] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.439814] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.439970] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.440131] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.460862] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.461124] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 974.461261] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.461438] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.461823] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-6641a375-773a-4e77-93b5-e8cba418b05d taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.462017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.462155] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.462428] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.462574] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6641a375-773a-4e77-93b5-e8cba418b05d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.964559] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.964794] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.964925] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.965255] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.965458] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.965808] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.966010] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.966148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.966464] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.966620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.966915] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.967129] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.967209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.967455] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.967596] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.967746] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 6641a375-773a-4e77-93b5-e8cba418b05d is going to be updated. [ 974.992204] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.992457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.992664] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.992997] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.993238] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.993525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.050069] env[69255]: INFO networking_nsxv3.common.synchronization [req-07f03a67-3af1-477f-94c4-a4672aff06e9 req-b1e0f9d1-ae4f-48b3-9957-ce61dc0bad58 tempest-InstanceActionsV221TestJSON-106524551 tempest-InstanceActionsV221TestJSON-106524551-project-member] Enqueued Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_members [ 975.050439] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGHEST for action security_group_members [ 975.050788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.050924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.051016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.051212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.051450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.051555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.051615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.051762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.051845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.051934] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.556772] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.557153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.557153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.557447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.557447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.557620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.557727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.557727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.558035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.558035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.558179] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dcc0af-a718-4357-b117-90efbb3d6bec is going to be updated. [ 975.588427] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.588616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.588838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.588952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.589124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.601282] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dcc0af-a718-4357-b117-90efbb3d6bec in Status: IN_PROGRESS for 2s [ 975.674408] env[69255]: INFO networking_nsxv3.common.synchronization [req-72425d78-562a-48ca-aa0f-59c93f919e30 req-4e9f659d-9776-495e-a3e2-dc819b8f54b5 service nova] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_rules [ 975.674592] env[69255]: INFO networking_nsxv3.common.synchronization [req-72425d78-562a-48ca-aa0f-59c93f919e30 req-4e9f659d-9776-495e-a3e2-dc819b8f54b5 service nova] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 975.674736] env[69255]: INFO networking_nsxv3.common.synchronization [req-72425d78-562a-48ca-aa0f-59c93f919e30 req-4e9f659d-9776-495e-a3e2-dc819b8f54b5 service nova] Enqueued Resource ID: 6641a375-773a-4e77-93b5-e8cba418b05d with Priority: HIGHEST for action port [ 975.674988] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_rules [ 975.675149] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 975.675250] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6641a375-773a-4e77-93b5-e8cba418b05d with Priority: HIGHEST for action port [ 975.675858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.676061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.676061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.676280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.676407] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.678028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.678028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.678028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.678233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.678424] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.678507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.678550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.678759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.678759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.678882] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.680362] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6641a375-773a-4e77-93b5-e8cba418b05d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.680362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.680362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.680362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.680362] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6641a375-773a-4e77-93b5-e8cba418b05d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.182349] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.183677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.183792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.184321] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6641a375-773a-4e77-93b5-e8cba418b05d with status ACTIVE [ 976.184456] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.184522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.184557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.184820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.184937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.185158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.185290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.185349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.185551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.185982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.185982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.186127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.186127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.186229] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.187648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.187648] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6641a375-773a-4e77-93b5-e8cba418b05d is going to be updated. [ 976.215180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.215332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.215405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.215609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.215801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.215991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6641a375-773a-4e77-93b5-e8cba418b05d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.686344] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.188847] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.189065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.189138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.189352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.189443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.189543] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 977.223031] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.223031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.223031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.223320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.223320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.234584] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 977.437022] env[69255]: INFO networking_nsxv3.common.synchronization [req-b4ec0cb0-9e87-4224-9230-1bfb7eb4a0dc req-a9fc4096-bce3-4007-8d53-a56a7578db27 tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 977.437309] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 977.437955] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.438762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.438865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.439139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.439303] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.439425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.439462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.439612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.439711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.439808] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.610895] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dcc0af-a718-4357-b117-90efbb3d6bec in Status: SUCCESS [ 977.611099] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dcc0af-a718-4357-b117-90efbb3d6bec deletion is rescheduled due to dependency. [ 977.611219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.757824] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.759091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-295" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.759091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-295" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.759091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-295" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.759091] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.759091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.759091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.759423] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.759423] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.759680] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.759741] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.759827] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.759945] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.760089] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.760210] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.760379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.783553] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.783731] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.783874] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.784074] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-295" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.784392] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.784595] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.784730] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.785081] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.785226] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec9eb2f4-f8a0-46d4-b9e9-37962984e75a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.946885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.946885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.946885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.947380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 already deleted. [ 977.947380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.288641] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.288766] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.288934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.289136] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.289277] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.289443] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port ec9eb2f4-f8a0-46d4-b9e9-37962984e75a not found, creating... [ 978.289764] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.289859] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.290202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.290202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.290381] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.291014] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.291014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.291014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.295021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.295021] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.295021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a is going to be created. [ 978.314029] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.314250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.314377] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.314751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.315117] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.315351] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.052995] env[69255]: INFO networking_nsxv3.common.synchronization [req-b4ec0cb0-9e87-4224-9230-1bfb7eb4a0dc req-a65dea29-34fb-4af0-9c0e-6a93b8dee369 service nova] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 979.055208] env[69255]: INFO networking_nsxv3.common.synchronization [req-b4ec0cb0-9e87-4224-9230-1bfb7eb4a0dc req-a65dea29-34fb-4af0-9c0e-6a93b8dee369 service nova] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 979.055476] env[69255]: INFO networking_nsxv3.common.synchronization [req-b4ec0cb0-9e87-4224-9230-1bfb7eb4a0dc req-a65dea29-34fb-4af0-9c0e-6a93b8dee369 service nova] Enqueued Resource ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with Priority: HIGHEST for action port [ 979.055745] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 979.055884] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 979.055990] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with Priority: HIGHEST for action port [ 979.056687] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.056827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.056891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.057115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.057247] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.058172] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.058339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.058451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.058664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.058963] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.059103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.059184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.059325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.059478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.059514] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.060677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.060784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.060851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.061051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.061124] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec9eb2f4-f8a0-46d4-b9e9-37962984e75a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.260851] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 979.260851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.260851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.261138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.261335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.261499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.261584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.261784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.261892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.262012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.262135] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.561681] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.562940] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.563110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.563318] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with status ACTIVE [ 979.563722] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.563722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.563722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.563897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.563986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.565025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.565545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565545] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a is going to be updated. [ 979.588219] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.588965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.588965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.588965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.588965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.589250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.768021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.768021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.768021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.768021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.768021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.769056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.769056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.769056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.769056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.769056] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.067567] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.271082] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d629ccb4-175d-4e83-941e-35fb3996c7a9: rpc.has_security_group_logging(os_id): False [ 980.290392] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.290571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.290624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.290829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.310985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.311296] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.311418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.311486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.311689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.311774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.311962] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.312089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.312159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.312349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.312482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.312715] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.312919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.313035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.313206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.313284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.313406] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 980.376678] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.376867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.376934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.377144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.377295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.392424] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 980.571576] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.571744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.571798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.572048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.572148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.572250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be created. [ 980.599691] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.599892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.599892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.600131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.600290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.609675] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: UNINITIALIZED for 2s [ 981.815048] env[69255]: INFO networking_nsxv3.common.synchronization [req-c0656fa0-c058-427a-9edb-3aed2ba8dd6b req-5ddb588d-76eb-4e95-b716-c0b915f8200a tempest-MigrationsAdminTest-1462281717 tempest-MigrationsAdminTest-1462281717-project-member] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 981.815699] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 981.816146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.816299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.816381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.816618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.816958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.817039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.817108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.817265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.817365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.817488] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.320019] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.413472] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 982.413712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.621631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 982.621905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.622111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.622476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.622601] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.622711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.622855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.622932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.622988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.623087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.623181] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.822280] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.125472] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.325644] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.325644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.325644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.325644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.325644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.325644] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be updated. [ 983.359360] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.359512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.359585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.359846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.359958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.372275] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: IN_PROGRESS for 2s [ 983.627875] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2: rpc.has_security_group_logging(os_id): False [ 983.648799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.648977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.649039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.649245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.649336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.649599] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.649746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.649746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.649909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.650029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.650158] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be created. [ 983.752873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.753185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.753185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.753492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.753549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.788790] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: IN_PROGRESS for 2s [ 985.372504] env[69255]: INFO networking_nsxv3.common.synchronization [req-8deb5283-23a3-4a3b-8635-224a347cf4f9 req-eef045bf-e7ec-4577-85db-de3d9abe6e8a tempest-ServerAddressesTestJSON-636634939 tempest-ServerAddressesTestJSON-636634939-project-member] Enqueued Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_members [ 985.374088] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_members [ 985.374437] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.374559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.377111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.377111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.377111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.377111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.377111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.377111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.377111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.377111] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.387303] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 985.387748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.716069] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.716069] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-569" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.716262] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-569" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.716740] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-569" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.717111] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.717346] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.717458] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.717705] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.717944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.718192] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.718319] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.718446] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.718604] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.718732] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.718865] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.719061] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.741086] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.741273] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.741656] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.741656] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-569" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.741913] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-4bec3ba4-2b36-4856-b346-14cf11fab506 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.742115] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.742262] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.742593] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.742786] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bec3ba4-2b36-4856-b346-14cf11fab506',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.802625] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 985.803401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.879287] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.879767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.879859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.880150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.880212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.880429] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.880535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.880604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.880818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.880885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.881023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf245b92-395b-436b-927d-80e3a468ef38 already deleted. [ 985.881113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.246423] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.247289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.247289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.247289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.247289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.247450] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 4bec3ba4-2b36-4856-b346-14cf11fab506 not found, creating... [ 986.247709] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.247925] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.248105] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.248459] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.248546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.248821] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.249110] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.249217] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.249473] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.249585] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.249735] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 4bec3ba4-2b36-4856-b346-14cf11fab506 is going to be created. [ 986.271554] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.272153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.272316] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.272609] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.272851] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.273184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.098018] env[69255]: INFO networking_nsxv3.common.synchronization [req-8deb5283-23a3-4a3b-8635-224a347cf4f9 req-ba1a15c9-3275-4895-9501-67bf3c805e2a service nova] Enqueued Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_rules [ 987.098018] env[69255]: INFO networking_nsxv3.common.synchronization [req-8deb5283-23a3-4a3b-8635-224a347cf4f9 req-ba1a15c9-3275-4895-9501-67bf3c805e2a service nova] Enqueued Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_members [ 987.098018] env[69255]: INFO networking_nsxv3.common.synchronization [req-8deb5283-23a3-4a3b-8635-224a347cf4f9 req-ba1a15c9-3275-4895-9501-67bf3c805e2a service nova] Enqueued Resource ID: 4bec3ba4-2b36-4856-b346-14cf11fab506 with Priority: HIGHEST for action port [ 987.100439] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_rules [ 987.100606] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_members [ 987.100708] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bec3ba4-2b36-4856-b346-14cf11fab506 with Priority: HIGHEST for action port [ 987.101055] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.101196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.101268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.101558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.101648] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.103063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.103063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.103063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.104723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.105040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.105174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.105239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.105418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.105507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.105620] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.106574] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bec3ba4-2b36-4856-b346-14cf11fab506 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.106687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.110147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.110147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.110147] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bec3ba4-2b36-4856-b346-14cf11fab506',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.567666] env[69255]: INFO networking_nsxv3.common.synchronization [None req-54ddcc1c-51ba-4b36-a390-98ea324f17e5 None None] Enqueued Resource ID: 2ba4c715-3843-4db3-9411-c6619c5666c5 with Priority: HIGHEST for action port [ 987.570096] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba4c715-3843-4db3-9411-c6619c5666c5 with Priority: HIGHEST for action port [ 987.570477] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba4c715-3843-4db3-9411-c6619c5666c5 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.570597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba4c715-3843-4db3-9411-c6619c5666c5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.570922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba4c715-3843-4db3-9411-c6619c5666c5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.570922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba4c715-3843-4db3-9411-c6619c5666c5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.572088] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba4c715-3843-4db3-9411-c6619c5666c5',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.612585] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bec3ba4-2b36-4856-b346-14cf11fab506 with status ACTIVE [ 987.612743] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.612911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.613034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.613276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.613460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.613551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.613656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.613713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.613877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.613971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.614215] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.614390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.614390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.614512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.614584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.614806] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bec3ba4-2b36-4856-b346-14cf11fab506 is going to be updated. [ 987.616019] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.617017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.617226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.640351] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.640602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.640602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.640778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.640923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.641165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bec3ba4-2b36-4856-b346-14cf11fab506" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.080822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ba4c715-3843-4db3-9411-c6619c5666c5 [ 988.080822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.080822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.080822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.080822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.080822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.080822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ba4c715-3843-4db3-9411-c6619c5666c5 already deleted. [ 988.081354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba4c715-3843-4db3-9411-c6619c5666c5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.118999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.621880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.622081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.622166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.622409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.622517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.623950] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf245b92-395b-436b-927d-80e3a468ef38 is going to be created. [ 988.651025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.651025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.651025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.651025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.651025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.663577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf245b92-395b-436b-927d-80e3a468ef38 in Status: UNINITIALIZED for 2s [ 989.360722] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f033dba0-143a-4c82-9404-0b0f3328d96f tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_rules [ 989.361285] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_rules [ 989.361591] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.361715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.361781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.362054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.362138] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.458659] env[69255]: INFO networking_nsxv3.common.synchronization [None req-01ac7da3-141f-4e35-908f-5d8184d97b9b tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_rules [ 989.459225] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_rules [ 989.459540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.459650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.889012] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.889740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.889740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.891027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.891027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.891027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a already deleted. [ 989.891027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.891027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.891027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.891027] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.193749] env[69255]: INFO networking_nsxv3.common.synchronization [None req-55581a61-8810-4d09-b9ed-b2daded1b966 None None] Enqueued Resource ID: b480bd98-c0eb-4104-a851-85278c14d8e1 with Priority: HIGHEST for action port [ 990.193749] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b480bd98-c0eb-4104-a851-85278c14d8e1 with Priority: HIGHEST for action port [ 990.193749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b480bd98-c0eb-4104-a851-85278c14d8e1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.193749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b480bd98-c0eb-4104-a851-85278c14d8e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.193749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b480bd98-c0eb-4104-a851-85278c14d8e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.194147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b480bd98-c0eb-4104-a851-85278c14d8e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.194147] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b480bd98-c0eb-4104-a851-85278c14d8e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.420665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.420665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.420665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.421095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.421095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.421095] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a already deleted. [ 990.421760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.675360] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf245b92-395b-436b-927d-80e3a468ef38 in Status: SUCCESS [ 990.675833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.675833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.676096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.676161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.676274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.676337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.676482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.676561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.676642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.676752] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.695945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b480bd98-c0eb-4104-a851-85278c14d8e1 [ 990.696273] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.696349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.696386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.696636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.696739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.696834] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b480bd98-c0eb-4104-a851-85278c14d8e1 already deleted. [ 990.696916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b480bd98-c0eb-4104-a851-85278c14d8e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.182565] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.182769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.182838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.182999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.183188] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.183336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.183398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.183496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.183583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.183710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.183869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.183980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.184215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.184338] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.184409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.184615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.184665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.184751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.184846] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.687915] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf245b92-395b-436b-927d-80e3a468ef38: rpc.has_security_group_logging(os_id): False [ 991.707839] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.707984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.708074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.708296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.708392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.708632] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.708731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.708792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.708945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.709035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.709218] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.709310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.709373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.709510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.709592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.709808] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.709904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.709966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.710482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.710601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.710714] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf245b92-395b-436b-927d-80e3a468ef38 is going to be created. [ 991.776085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.776085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.776085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.776085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.776085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.791932] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf245b92-395b-436b-927d-80e3a468ef38 in Status: IN_PROGRESS for 2s [ 992.325746] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-117a5bdf-bdeb-4c21-8ab1-4cfb43468791 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 992.326279] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 992.326659] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.326760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.326809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.327016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.327885] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.327997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.328079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.328277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.328363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.328457] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.749402] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.750032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.750032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.750320] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.750613] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.750849] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.750936] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.751187] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.751402] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.751574] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.751826] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.751826] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.751923] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.752133] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.752133] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.752501] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.773604] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.773822] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 992.774014] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.774248] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.774645] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-fa523d7b-8a94-4691-89e6-29c36aa6aaae taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.774875] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.775054] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.775483] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.775691] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa523d7b-8a94-4691-89e6-29c36aa6aaae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.831070] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.831070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.831070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.831070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.831343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.831446] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.831628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.831716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.831922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.832051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.832202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 992.862713] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.862941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.862941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.863159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.863312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.873209] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 993.278992] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.279255] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.279411] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.279894] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.280138] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.280325] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port fa523d7b-8a94-4691-89e6-29c36aa6aaae not found, creating... [ 993.280624] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.280842] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.280940] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.281216] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.281365] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.281822] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.282025] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.282167] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.282421] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.282569] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.282730] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: fa523d7b-8a94-4691-89e6-29c36aa6aaae is going to be created. [ 993.303925] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.304289] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.304495] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.304870] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.305267] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.305647] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.804586] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf245b92-395b-436b-927d-80e3a468ef38 in Status: SUCCESS [ 993.804885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.348023] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-dba2351f-0787-4873-bd10-f987ae3edbd8 service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 994.348023] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-dba2351f-0787-4873-bd10-f987ae3edbd8 service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 994.348023] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-dba2351f-0787-4873-bd10-f987ae3edbd8 service nova] Enqueued Resource ID: fa523d7b-8a94-4691-89e6-29c36aa6aaae with Priority: HIGHEST for action port [ 994.348023] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 994.348023] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 994.348023] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa523d7b-8a94-4691-89e6-29c36aa6aaae with Priority: HIGHEST for action port [ 994.348023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.348023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.348782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.349126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.349421] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.351150] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.351400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.351729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa523d7b-8a94-4691-89e6-29c36aa6aaae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.352016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.352202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.352494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.353028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa523d7b-8a94-4691-89e6-29c36aa6aaae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.854911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.855179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.855323] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa523d7b-8a94-4691-89e6-29c36aa6aaae with status ACTIVE [ 994.855525] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.855637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.855705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.855940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.856086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.856278] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.856419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.856473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.856605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.856689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.856883] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.856983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.857064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.857248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.857281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.857347] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa523d7b-8a94-4691-89e6-29c36aa6aaae is going to be updated. [ 994.881305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.881464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.881533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.881741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.881883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.882049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa523d7b-8a94-4691-89e6-29c36aa6aaae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.882997] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 994.883229] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 deletion is rescheduled due to dependency. [ 994.883459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.883958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.884192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.884397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.884519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.884601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.884763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.884846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.884940] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.388085] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.895306] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.042703] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-3a7aecb1-e79b-42b7-aaeb-2607bac52ac9 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 996.043855] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 996.044222] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.044222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.392355] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.392833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.393058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.393364] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.394249] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.394393] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.394501] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.394828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.395113] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.395577] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.395577] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.395673] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.395848] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.395989] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.396134] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.396341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.399083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.399296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.399413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.399698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.399885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.399885] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 996.426964] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.427212] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.427299] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.427450] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-93" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.428070] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.428354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.428354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.428618] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.428742] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1c06b2a-c8dd-421e-8221-29ab07b4ba41',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.439522] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.439779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.439872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.440099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.440287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.450045] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 996.935024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.935024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port b1c06b2a-c8dd-421e-8221-29ab07b4ba41 not found, creating... [ 996.935024] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.935024] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.936031] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.936031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.936031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.936031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.936031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.936031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: b1c06b2a-c8dd-421e-8221-29ab07b4ba41 is going to be created. [ 996.960980] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.960980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.960980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.960980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.960980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.960980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.216030] env[69255]: INFO networking_nsxv3.common.synchronization [req-bdf9b386-4892-4596-97d2-fc13f2274d71 req-7f58bb64-6fc9-4b3f-8a57-0f4fb5ed8ead tempest-ServerAddressesTestJSON-636634939 tempest-ServerAddressesTestJSON-636634939-project-member] Enqueued Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_members [ 997.216030] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGHEST for action security_group_members [ 997.216030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.216030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.216030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.216030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.219441] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.219441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.219441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.219441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.219441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.219441] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.655236] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-09da61e5-2569-4244-846a-2713360f835d service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 997.655236] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-09da61e5-2569-4244-846a-2713360f835d service nova] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 997.655236] env[69255]: INFO networking_nsxv3.common.synchronization [req-d087f552-dd8a-49a5-b44b-710ced579975 req-09da61e5-2569-4244-846a-2713360f835d service nova] Enqueued Resource ID: b1c06b2a-c8dd-421e-8221-29ab07b4ba41 with Priority: HIGHEST for action port [ 997.655236] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_rules [ 997.655236] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 997.655236] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c06b2a-c8dd-421e-8221-29ab07b4ba41 with Priority: HIGHEST for action port [ 997.655625] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.655685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.656053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.656053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.660316] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.660473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.660565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.660826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.660907] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1c06b2a-c8dd-421e-8221-29ab07b4ba41',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.720459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.720637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.720714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.720921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.721039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.721246] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.721345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.721407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.721564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.721642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.721730] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf245b92-395b-436b-927d-80e3a468ef38 is going to be updated. [ 997.752217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.752442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.752442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.752632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.752776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.761781] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf245b92-395b-436b-927d-80e3a468ef38 in Status: IN_PROGRESS for 2s [ 998.169452] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1c06b2a-c8dd-421e-8221-29ab07b4ba41 with status ACTIVE [ 998.169724] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.170997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.171127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.171320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.171600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.171687] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.171801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.171928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.172022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.172089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.172407] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.172407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.172407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.172536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.172690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.172690] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1c06b2a-c8dd-421e-8221-29ab07b4ba41 is going to be updated. [ 998.202436] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.202597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.202705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.202886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.203042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.203205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1c06b2a-c8dd-421e-8221-29ab07b4ba41" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.460905] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 998.462054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.462054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.462054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.462054] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.462642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.462642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.462642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.462642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.462642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.462979] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.467803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.467803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.467803] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.467803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.467803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.467803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.467803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.467803] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.614967] env[69255]: INFO networking_nsxv3.common.synchronization [req-be33856b-1ef1-4b1e-a940-ef20bac09b0e req-c75fb0af-297e-4948-842c-2b7677c2489b tempest-ServersNegativeTestMultiTenantJSON-1248991006 tempest-ServersNegativeTestMultiTenantJSON-1248991006-project-member] Enqueued Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_members [ 998.616081] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_members [ 998.616664] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.616823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.616918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.617189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.617376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.617514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.617605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.617777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.617882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.617966] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.970590] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.971799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.971952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.120284] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.121869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.121869] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1520d4fa-edba-41bd-8755-7e34c635106e already deleted. [ 999.121869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.151889] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.152134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.152271] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.152633] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.152934] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.153109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.153233] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.153479] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.153629] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.153870] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.154010] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.154154] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.154250] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.154368] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.154529] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.154630] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.189228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.189622] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 999.189622] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.189746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-167" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.190077] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-03e23134-e391-45b6-98d7-4b10ba9b842a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.190263] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.190388] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.190737] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.190945] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03e23134-e391-45b6-98d7-4b10ba9b842a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.473677] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.696404] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.696644] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.697816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.697816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.697816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.697816] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 03e23134-e391-45b6-98d7-4b10ba9b842a not found, creating... [ 999.697816] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.697816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.698178] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.698219] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.698378] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.698745] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.698931] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.699102] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.699299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.699468] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.699903] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 03e23134-e391-45b6-98d7-4b10ba9b842a is going to be created. [ 999.723633] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.723892] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.724050] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.724382] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.724644] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.724893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.776995] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf245b92-395b-436b-927d-80e3a468ef38 in Status: SUCCESS [ 999.776995] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf245b92-395b-436b-927d-80e3a468ef38 deletion is rescheduled due to dependency. [ 999.776995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.977502] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.977734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.977935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.978138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.978258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.978364] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 1000.009574] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.009862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.009862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.010014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.010157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.020013] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 1000.624251] env[69255]: INFO networking_nsxv3.common.synchronization [req-be33856b-1ef1-4b1e-a940-ef20bac09b0e req-abeb1f75-60f6-428e-b264-733af5a96326 service nova] Enqueued Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_rules [ 1000.624533] env[69255]: INFO networking_nsxv3.common.synchronization [req-be33856b-1ef1-4b1e-a940-ef20bac09b0e req-abeb1f75-60f6-428e-b264-733af5a96326 service nova] Enqueued Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_members [ 1000.624604] env[69255]: INFO networking_nsxv3.common.synchronization [req-be33856b-1ef1-4b1e-a940-ef20bac09b0e req-abeb1f75-60f6-428e-b264-733af5a96326 service nova] Enqueued Resource ID: 03e23134-e391-45b6-98d7-4b10ba9b842a with Priority: HIGHEST for action port [ 1000.624843] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_rules [ 1000.624975] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_members [ 1000.625083] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03e23134-e391-45b6-98d7-4b10ba9b842a with Priority: HIGHEST for action port [ 1000.625835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.625975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.626087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.626317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.626400] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.627900] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.628038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.628108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.628435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.628435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.628557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.628592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.630765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.630765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.630765] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.630765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-03e23134-e391-45b6-98d7-4b10ba9b842a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.630765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.630765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.630765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.630765] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03e23134-e391-45b6-98d7-4b10ba9b842a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.132837] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.133181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.133181] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.134478] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03e23134-e391-45b6-98d7-4b10ba9b842a with status ACTIVE [ 1001.134666] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.134781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.134832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.135085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.135207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.135442] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.135570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.135704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.135842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.135945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.136196] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.136339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.136424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.136618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.136659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.136772] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03e23134-e391-45b6-98d7-4b10ba9b842a is going to be updated. [ 1001.162720] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.162909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.163025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.163664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.163664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.163664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03e23134-e391-45b6-98d7-4b10ba9b842a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.639318] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.033470] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 1002.034160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.034160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.034372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.034645] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.034810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.034925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.035180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.035309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.035422] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.142431] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.142566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.142690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.142826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.142917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.143050] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1520d4fa-edba-41bd-8755-7e34c635106e is going to be created. [ 1002.171043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.171297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.171356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.171878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.171878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.184498] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1520d4fa-edba-41bd-8755-7e34c635106e in Status: UNINITIALIZED for 2s [ 1002.538515] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.556253] env[69255]: INFO networking_nsxv3.common.synchronization [req-bb52d374-67b5-4f58-9f84-44da8ccb111a req-11692320-53fb-4c1b-ad7b-4fb9cc0e6554 tempest-ServerRescueTestJSON-1629852663 tempest-ServerRescueTestJSON-1629852663-project-member] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 1002.556253] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGHEST for action security_group_members [ 1002.556253] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.556253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.556253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.556253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.556253] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.556253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.556253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.556253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.557515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.557515] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.042161] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.060250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.060474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.060545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.060765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.060873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.061118] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.061241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.061302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.061508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.062166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.062166] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be updated. [ 1003.097654] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.097826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.097826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.098117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.098266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.110353] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: IN_PROGRESS for 2s [ 1003.545208] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.546790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.547064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.547377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.547866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.548110] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 1003.581409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.584394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.584394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.584394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.584394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.598330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 1004.194405] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1520d4fa-edba-41bd-8755-7e34c635106e in Status: SUCCESS [ 1004.194736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.194949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.195147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.195332] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.195454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.195509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.197073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.197073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.197073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.197073] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.701268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.701425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.701425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.701635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.701791] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.701884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.701944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.702110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.702199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.702286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.702432] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.702524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.702578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.702718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.702851] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.702941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.702999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.704036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.704036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.704036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.704036] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.123296] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 in Status: SUCCESS [ 1005.123296] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 deletion is rescheduled due to dependency. [ 1005.123296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.206875] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1520d4fa-edba-41bd-8755-7e34c635106e: rpc.has_security_group_logging(os_id): False [ 1005.232136] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.232136] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.232136] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.232136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.232734] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.232734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.232734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.232734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.232734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.232734] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1520d4fa-edba-41bd-8755-7e34c635106e is going to be created. [ 1005.298663] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.298820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.298888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.303303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.303607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.323785] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1520d4fa-edba-41bd-8755-7e34c635106e in Status: IN_PROGRESS for 2s [ 1005.579142] env[69255]: INFO networking_nsxv3.common.synchronization [req-3df4992c-fa38-4a45-be9c-0288be434bf9 req-41597c9e-3740-425f-b901-8426113ef2f1 tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 1005.579142] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 1005.579142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.579142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.579142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.579142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.579142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.579142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.579142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.582250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.582535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.582733] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.610291] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 1005.610509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.610597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.610808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.611024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.611167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.611236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.611397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.611477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.614858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.614858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.614858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.614858] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.088338] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.088525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.088579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.088820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.088904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.089115] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.089234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.089309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.089424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.089494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.089584] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 1006.116542] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.116832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.116832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.117111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.117207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.118313] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0282ecb1-21b7-414b-a78b-410dac72d851: rpc.has_security_group_logging(os_id): False [ 1006.129782] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 1006.134890] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.135065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.135166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.135429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.135538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.135750] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.135856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.135915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.136101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.136182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.136385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.136486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.136611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.136791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.136791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.138905] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.138905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.138905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.138905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.138905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.138905] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 1006.166913] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.166913] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.167390] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.167755] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.168499] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.168664] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.168765] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.169279] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.169279] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.169505] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.169619] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.169736] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.169845] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.169957] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.170079] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.170228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.192150] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.192354] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.192603] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.192715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-442" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.193098] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.193228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.193349] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.193686] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.193842] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb2a75c-57a3-4a69-93c0-34f9dd8006e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.228510] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.228914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.228914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.229026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.229315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.243091] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 1006.697265] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.697497] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.697626] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.697906] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.698071] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.698261] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 not found, creating... [ 1006.698526] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.698685] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.698805] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.699028] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.699172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.699469] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.699624] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.699742] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.699951] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.703026] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.703026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 is going to be created. [ 1006.725140] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.725140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.725140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.725140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.725140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.725140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.336471] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1520d4fa-edba-41bd-8755-7e34c635106e in Status: SUCCESS [ 1007.336817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.769843] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-b17ca859-b184-4172-ab45-e5c254a42b50 tempest-ListServersNegativeTestJSON-567248915 tempest-ListServersNegativeTestJSON-567248915-project-member] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1007.770471] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1007.770842] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.770977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.772972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.775858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.776190] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.776370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.776370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.776692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.776692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.776836] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.830623] env[69255]: INFO networking_nsxv3.common.synchronization [req-3df4992c-fa38-4a45-be9c-0288be434bf9 req-71edfd53-70be-4f63-bd25-02dffbb4f5fc service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 1007.831034] env[69255]: INFO networking_nsxv3.common.synchronization [req-3df4992c-fa38-4a45-be9c-0288be434bf9 req-71edfd53-70be-4f63-bd25-02dffbb4f5fc service nova] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 1007.831282] env[69255]: INFO networking_nsxv3.common.synchronization [req-3df4992c-fa38-4a45-be9c-0288be434bf9 req-71edfd53-70be-4f63-bd25-02dffbb4f5fc service nova] Enqueued Resource ID: 3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 with Priority: HIGHEST for action port [ 1007.832897] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_rules [ 1007.832897] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 1007.833145] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 with Priority: HIGHEST for action port [ 1007.833477] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.833732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.833817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.834297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.834297] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.835535] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.835671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.835983] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.836226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.836331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.836689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.836869] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb2a75c-57a3-4a69-93c0-34f9dd8006e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.142239] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 1008.142239] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 1008.142239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.142239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.142239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.142239] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.142599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.142599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.142599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.142599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.142776] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.179993] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.179993] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.179993] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.180361] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.180556] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.180703] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.180833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.181102] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.181301] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.181570] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.182612] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.182612] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.182612] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.182612] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.182612] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.182612] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.202553] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.202917] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.202917] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.203085] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.203468] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-2a672680-dbba-4ed6-86a5-25a2d19dacaa taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.203675] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.203801] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.204152] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.204299] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a672680-dbba-4ed6-86a5-25a2d19dacaa',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.259551] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 1008.259551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.259551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.260239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.260239] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.280869] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.281079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.281284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.285092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.285254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.285478] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.285613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.285704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.286148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.286148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.286373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 already deleted. [ 1008.286373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.346606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.347822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 with status ACTIVE [ 1008.347822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.347822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.347822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.349069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.349069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.349069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.349069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.349069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.349069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.349069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.349069] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cb2a75c-57a3-4a69-93c0-34f9dd8006e1 is going to be updated. [ 1008.375120] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.375120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.375120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.375685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.375685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.375685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb2a75c-57a3-4a69-93c0-34f9dd8006e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.645433] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.707274] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.707274] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.707274] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.707274] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.707757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.707757] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 2a672680-dbba-4ed6-86a5-25a2d19dacaa not found, creating... [ 1008.707924] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.708114] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.708303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.708570] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.708705] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.709651] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.709876] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.710223] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.710819] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.710819] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.710819] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 2a672680-dbba-4ed6-86a5-25a2d19dacaa is going to be created. [ 1008.742662] env[69255]: INFO networking_nsxv3.common.synchronization [req-7ad56a85-c196-4e3a-b973-43f073c2bd16 req-5bf64c32-f746-4a70-a601-f591b8a91847 tempest-ServersNegativeTestJSON-1716894594 tempest-ServersNegativeTestJSON-1716894594-project-member] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 1008.743102] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGHEST for action security_group_members [ 1008.743526] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.743526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.744192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.744192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.744192] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.750473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.750473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.750473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.750473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.750473] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.757047] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.757321] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.757374] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.757686] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.757926] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.758188] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.762860] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.763033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.763091] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.763339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.763506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.763618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.763682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.764149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.764149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.764149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.764149] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.152342] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.261055] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.261243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.261293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.261517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.261609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.262030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.262172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.262267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.262441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.262929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.263061] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be updated. [ 1009.267427] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.267599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.267599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.267795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.267942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.268338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.268455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.268587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.268673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.268760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.268909] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.269016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.269071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.269205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.269338] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.269429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.269490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.270289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.270362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.270416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.270491] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.291170] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.291325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.291433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.292395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.301161] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: IN_PROGRESS for 2s [ 1009.354952] env[69255]: INFO networking_nsxv3.common.synchronization [req-7266c4d9-526b-4c5b-b612-205b1d14f951 req-4fbf0d18-7d4c-4f69-aa57-2a3399db5601 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 1009.355509] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 1009.355811] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.356033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.357993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.358123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.358325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.359269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.359344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.359533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.359623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.359723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.417835] env[69255]: INFO networking_nsxv3.common.synchronization [req-dd5a6603-67f6-45d6-a8a4-a9686489d3b1 req-85a69ebd-4a37-4cf6-999c-c434e2327e37 tempest-MultipleCreateTestJSON-892749091 tempest-MultipleCreateTestJSON-892749091-project-member] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 1009.418412] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGHEST for action security_group_members [ 1009.418731] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.418854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.655560] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.655834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.655834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.655995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.656089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.656191] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 1009.686857] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.687111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.687111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.687279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.687422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.696286] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 1009.707242] env[69255]: INFO networking_nsxv3.common.synchronization [None req-bb5a8e48-b6c8-4c77-902e-595128a56a9b None None] Enqueued Resource ID: 6db71411-eb64-49d8-87df-369727fbc7d0 with Priority: HIGHEST for action port [ 1009.707925] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db71411-eb64-49d8-87df-369727fbc7d0 with Priority: HIGHEST for action port [ 1009.708593] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-6db71411-eb64-49d8-87df-369727fbc7d0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.708713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6db71411-eb64-49d8-87df-369727fbc7d0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.709395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6db71411-eb64-49d8-87df-369727fbc7d0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.709395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6db71411-eb64-49d8-87df-369727fbc7d0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.709395] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db71411-eb64-49d8-87df-369727fbc7d0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.774410] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0282ecb1-21b7-414b-a78b-410dac72d851: rpc.has_security_group_logging(os_id): False [ 1009.796334] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.796334] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.796334] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.796334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.796874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.796874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.796874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.796874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.796874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.796874] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 1009.862480] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.886749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.886877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.886929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.887398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.887398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.919452] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 1009.934828] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-557a5a70-128e-4d39-82e3-e29536d6ea0c service nova] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_rules [ 1009.935035] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-557a5a70-128e-4d39-82e3-e29536d6ea0c service nova] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1009.935254] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-557a5a70-128e-4d39-82e3-e29536d6ea0c service nova] Enqueued Resource ID: 2a672680-dbba-4ed6-86a5-25a2d19dacaa with Priority: HIGHEST for action port [ 1009.935955] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_rules [ 1009.935955] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1009.935955] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a672680-dbba-4ed6-86a5-25a2d19dacaa with Priority: HIGHEST for action port [ 1009.936514] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.936675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.936808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.937033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.937106] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.938840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.938840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.938840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.939385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.939385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.939385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.939385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.939623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.939623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.939623] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.941194] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a672680-dbba-4ed6-86a5-25a2d19dacaa taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.941318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.941383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.941631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.941631] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a672680-dbba-4ed6-86a5-25a2d19dacaa',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.212413] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6db71411-eb64-49d8-87df-369727fbc7d0 [ 1010.212671] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.212796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.212864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.213114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.213333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.213333] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6db71411-eb64-49d8-87df-369727fbc7d0 already deleted. [ 1010.213427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6db71411-eb64-49d8-87df-369727fbc7d0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.369165] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.446542] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.446701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.446874] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.447752] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a672680-dbba-4ed6-86a5-25a2d19dacaa with status ACTIVE [ 1010.447952] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.448133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.448220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.448494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.448585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.449158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.449264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.449336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.449519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.449602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.449792] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.449979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.450064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.450215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.450289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.450374] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a672680-dbba-4ed6-86a5-25a2d19dacaa is going to be updated. [ 1010.479201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.479201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.479201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.479201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.479201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.479201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a672680-dbba-4ed6-86a5-25a2d19dacaa" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.687088] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-2bceeeac-5269-439c-b642-d888184e6f86 tempest-ListServersNegativeTestJSON-567248915 tempest-ListServersNegativeTestJSON-567248915-project-member] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1010.688031] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1010.688417] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.688541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.871888] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.872163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.872266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.872611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.872743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.872842] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 1010.908816] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.909083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.909210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.909452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.909616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.921651] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 1010.954024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.178927] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.179194] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.179427] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.179829] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.180887] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.181142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.181347] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.181911] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.182168] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.182538] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.182756] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.182955] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.183136] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.183305] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.183541] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.183746] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.203287] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.203464] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1011.203617] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.203784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.204120] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-dac8008b-fad1-4a01-94a3-91caaab8ad73 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.204298] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.204421] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.204784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.204932] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac8008b-fad1-4a01-94a3-91caaab8ad73',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.242821] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a58e25e3-ab8d-44b0-812a-9eeda209f835 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_rules [ 1011.244250] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_rules [ 1011.244795] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.244999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.247012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.247415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.248112] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.313103] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 in Status: SUCCESS [ 1011.313296] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 deletion is rescheduled due to dependency. [ 1011.313421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.388881] env[69255]: INFO networking_nsxv3.common.synchronization [None req-17ad7bca-5352-41e4-b1d8-01e0151c8e19 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_rules [ 1011.389484] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_rules [ 1011.389788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.389892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.456718] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.456945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.456991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.457642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.457642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.457642] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be created. [ 1011.485204] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.485425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.485425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.488430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.488430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.497103] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: UNINITIALIZED for 2s [ 1011.708528] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 1011.708711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.709317] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.709537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.709685] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.709960] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.710126] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.710281] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port dac8008b-fad1-4a01-94a3-91caaab8ad73 not found, creating... [ 1011.710540] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.710746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.710819] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.711384] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.711798] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.713151] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.713800] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.716457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.716457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.716457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.716457] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: dac8008b-fad1-4a01-94a3-91caaab8ad73 is going to be created. [ 1011.716457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.716457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.716900] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.716900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.716900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.717172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.717312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.717428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.717548] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.771072] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.771533] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.771533] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.771757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.772232] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.772565] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.788306] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.788306] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 already deleted. [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.788306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.788306] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.934480] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 1011.934767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.224028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.224028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.224028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.224028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.224028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.224902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.224902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.224902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.224902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.224902] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.315449] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.316110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.316297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.317075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.317075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.317075] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 already deleted. [ 1012.317075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.387751] env[69255]: INFO networking_nsxv3.common.synchronization [None req-43899ca9-ebb2-46b1-ba26-ede8713e039e None None] Enqueued Resource ID: ef40ef68-7d71-47f7-9b43-3ffd1aed6865 with Priority: HIGHEST for action port [ 1012.388350] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef40ef68-7d71-47f7-9b43-3ffd1aed6865 with Priority: HIGHEST for action port [ 1012.388877] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef40ef68-7d71-47f7-9b43-3ffd1aed6865 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.389012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef40ef68-7d71-47f7-9b43-3ffd1aed6865" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.389769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef40ef68-7d71-47f7-9b43-3ffd1aed6865" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.390204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef40ef68-7d71-47f7-9b43-3ffd1aed6865" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.391495] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef40ef68-7d71-47f7-9b43-3ffd1aed6865',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.698090] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-02dedfd4-c322-4cb3-9568-90a5d2fb6f08 service nova] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_rules [ 1012.698636] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-02dedfd4-c322-4cb3-9568-90a5d2fb6f08 service nova] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1012.698905] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-02dedfd4-c322-4cb3-9568-90a5d2fb6f08 service nova] Enqueued Resource ID: dac8008b-fad1-4a01-94a3-91caaab8ad73 with Priority: HIGHEST for action port [ 1012.699553] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_rules [ 1012.699825] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1012.700113] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac8008b-fad1-4a01-94a3-91caaab8ad73 with Priority: HIGHEST for action port [ 1012.700497] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.700710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.701097] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.701309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.702913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-dac8008b-fad1-4a01-94a3-91caaab8ad73 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.702913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.702913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.702913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.702913] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac8008b-fad1-4a01-94a3-91caaab8ad73',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.729624] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3: rpc.has_security_group_logging(os_id): False [ 1012.749677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.749817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.749862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.750118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.750211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.750606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.751062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.751062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.754163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.754163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.754163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.754163] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 1012.824942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.825120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.825164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.825874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.825874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.842577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 1012.899478] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef40ef68-7d71-47f7-9b43-3ffd1aed6865 [ 1012.901256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.901626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.901967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.902333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.903019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.903777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef40ef68-7d71-47f7-9b43-3ffd1aed6865 already deleted. [ 1012.903777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef40ef68-7d71-47f7-9b43-3ffd1aed6865" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.936764] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.936764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.936764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.936764] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.149198] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-7bdcd9d0-9444-471d-998c-78bca90af768 tempest-ListServersNegativeTestJSON-567248915 tempest-ListServersNegativeTestJSON-567248915-project-member] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1013.149198] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1013.149783] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.150121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209289] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dac8008b-fad1-4a01-94a3-91caaab8ad73 with status ACTIVE [ 1013.209289] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209289] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209289] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.209289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209289] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dac8008b-fad1-4a01-94a3-91caaab8ad73 is going to be updated. [ 1013.235938] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.235938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.235938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.235938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.235938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.235938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dac8008b-fad1-4a01-94a3-91caaab8ad73" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.438825] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.439192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.439192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.439271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.439553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.439877] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.439993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.440092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.440441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.440559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.440707] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be updated. [ 1013.470555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.470646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.470709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.473155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.473155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.481717] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: IN_PROGRESS for 2s [ 1013.496980] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.496980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.496980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.497160] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.497313] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.498032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.498032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.498032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.498204] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.498420] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.498645] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.498738] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.498873] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.499203] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.499359] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.500044] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.512546] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1013.512850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.513075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.513458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.513698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.513895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.513952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.514133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.514250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.514343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.514466] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.516205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.516205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.516205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.516205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.516205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.516409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.516665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.516665] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.526475] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.526663] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.526810] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.527012] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-367" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.527743] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-22250f0e-8d39-45e3-a4c7-70be98deb93a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.527743] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.527743] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.527988] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.528156] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22250f0e-8d39-45e3-a4c7-70be98deb93a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.727035] env[69255]: INFO networking_nsxv3.common.synchronization [req-3dbb75fd-1bb1-4d5a-9a57-29f14504bdf1 req-4235a393-b897-49bc-86da-501eeccfa437 tempest-ServersNegativeTestMultiTenantJSON-1248991006 tempest-ServersNegativeTestMultiTenantJSON-1248991006-project-member] Enqueued Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_members [ 1013.727507] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGHEST for action security_group_members [ 1013.727819] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.727943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.728024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.728227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.728374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.728474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.728553] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.728709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.728794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.728886] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.018729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.018930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.019455] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.033129] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.033309] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.033426] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.033715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.033874] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.034045] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 22250f0e-8d39-45e3-a4c7-70be98deb93a not found, creating... [ 1014.034311] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.034534] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.034756] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.035190] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.035359] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.035670] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.035835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.035968] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.036220] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.036371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.036527] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 22250f0e-8d39-45e3-a4c7-70be98deb93a is going to be created. [ 1014.061640] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.061640] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.061640] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.061980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.062266] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.063045] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.231427] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.231643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.231687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.231917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.232043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.232256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.232359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.232426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.232578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.232670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.232760] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1520d4fa-edba-41bd-8755-7e34c635106e is going to be updated. [ 1014.272349] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.272616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.272616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.272784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.272940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.283615] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1520d4fa-edba-41bd-8755-7e34c635106e in Status: IN_PROGRESS for 2s [ 1014.522518] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.779444] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-3f3afd72-be6c-41c0-908d-fd1ccbedf2d6 service nova] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_rules [ 1014.779444] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-3f3afd72-be6c-41c0-908d-fd1ccbedf2d6 service nova] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1014.779444] env[69255]: INFO networking_nsxv3.common.synchronization [req-74bf26a1-4a8a-429e-8b5c-2ad99cdbe923 req-3f3afd72-be6c-41c0-908d-fd1ccbedf2d6 service nova] Enqueued Resource ID: 22250f0e-8d39-45e3-a4c7-70be98deb93a with Priority: HIGHEST for action port [ 1014.779444] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_rules [ 1014.779807] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1014.779807] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22250f0e-8d39-45e3-a4c7-70be98deb93a with Priority: HIGHEST for action port [ 1014.780047] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.780168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.780374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.780374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.780547] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-22250f0e-8d39-45e3-a4c7-70be98deb93a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.781881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.781881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.781881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.781881] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22250f0e-8d39-45e3-a4c7-70be98deb93a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.857610] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 1014.857869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.025059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.025236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.025304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.025676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.025762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.025857] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1015.064577] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.064770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.064852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.065164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.065276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.078152] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1015.285729] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22250f0e-8d39-45e3-a4c7-70be98deb93a with status ACTIVE [ 1015.285729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.285729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.285729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.285729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.286548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.286548] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22250f0e-8d39-45e3-a4c7-70be98deb93a is going to be updated. [ 1015.308499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.308717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.308788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.309390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.309390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.309390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22250f0e-8d39-45e3-a4c7-70be98deb93a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.492057] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0282ecb1-21b7-414b-a78b-410dac72d851 in Status: SUCCESS [ 1015.492232] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 deletion is rescheduled due to dependency. [ 1015.492343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.642030] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1015.642320] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1016.295146] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1520d4fa-edba-41bd-8755-7e34c635106e in Status: SUCCESS [ 1016.295388] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1520d4fa-edba-41bd-8755-7e34c635106e deletion is rescheduled due to dependency. [ 1016.295483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.088300] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1017.088618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.088744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.088935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.089137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.089257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.089323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.089465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.089544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.089641] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.592657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.095883] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.600070] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.600385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.600551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.600810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.600979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.601145] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1018.634902] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.635085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.635142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.635362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.635518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.645715] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1019.781010] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1019.781315] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1020.659840] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1020.660011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.660118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.660344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.660533] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.660654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.660719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.660876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.660983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.661193] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.166517] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.669123] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.056762] env[69255]: INFO networking_nsxv3.common.synchronization [req-6356df37-d856-4b23-a35d-28eae3325a39 req-b9e50f3d-dea7-4d73-919b-0708e5144246 tempest-MigrationsAdminTest-1462281717 tempest-MigrationsAdminTest-1462281717-project-member] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 1022.056762] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGHEST for action security_group_members [ 1022.057284] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.057393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.057461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.058086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.058086] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.058260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.058260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.058487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.058563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.058662] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.066035] env[69255]: INFO networking_nsxv3.common.synchronization [req-58a6c947-fbca-41c9-be8e-d22deb6ae742 req-7ea9ad33-7f13-43c8-a904-82e5ef7eafda tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 1022.066527] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 1022.066802] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.066940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.066999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.067261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.067412] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.067512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.067580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.067747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.067830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.067921] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.172232] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.172623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.172623] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.173022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.173191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.173287] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1022.207127] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.207340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.207391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.207588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.207744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.218460] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1022.561057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.561279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.561396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.561579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.570329] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.583558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.583844] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.583963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.584063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.584282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.584368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.584460] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be updated. [ 1022.620427] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.620585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.620628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.620849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.620994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.636382] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: IN_PROGRESS for 2s [ 1022.875782] env[69255]: INFO networking_nsxv3.common.synchronization [req-8b2fdb8f-ae07-4a24-8ede-b8172faa6974 req-761a9a7c-68a0-4118-a3d3-1afa79ddc845 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1022.876424] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1022.876784] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.876978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.877177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.877411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.877612] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.877715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.877874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.878090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.878090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.878213] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.073815] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.197031] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.197509] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.197509] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.197760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.198015] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.198192] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.198316] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.198551] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.198700] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.198916] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.199089] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.199253] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.199381] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.199493] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.199605] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.199744] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.233729] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.233925] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1023.234092] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.234293] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.234602] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-f3c0344c-b9bd-4bef-b933-ea4f960eb924 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.234997] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.235353] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.235721] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.235884] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c0344c-b9bd-4bef-b933-ea4f960eb924',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.381765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.381765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.381765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.381765] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1023.407792] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.407792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.407792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.407792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.407792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.417739] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1023.577338] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.577537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.577604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.577804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.577897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.578010] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be updated. [ 1023.610205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.610433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.610547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.610839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.611061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.622436] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 1023.738733] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.738977] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.739176] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.739480] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.740668] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.740668] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port f3c0344c-b9bd-4bef-b933-ea4f960eb924 not found, creating... [ 1023.740668] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.740668] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.740668] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.740668] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.741012] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742699] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742699] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.742699] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.742699] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.742699] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742699] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: f3c0344c-b9bd-4bef-b933-ea4f960eb924 is going to be created. [ 1023.770517] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.770716] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.770878] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.771219] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.771524] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.771771] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.242454] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1024.242849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.242927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.243193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.243486] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.243637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.243710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.243892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.243980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.244084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.244289] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.244380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.244457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.244611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.244779] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.244933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.245053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.245236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.245336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.245462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.245557] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.246610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.246780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.246983] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.247051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.247147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.247272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.247380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.247471] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.504049] env[69255]: INFO networking_nsxv3.common.synchronization [req-8b2fdb8f-ae07-4a24-8ede-b8172faa6974 req-0e3e43d7-8090-4989-a1fb-7566b0613dd1 service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 1024.504242] env[69255]: INFO networking_nsxv3.common.synchronization [req-8b2fdb8f-ae07-4a24-8ede-b8172faa6974 req-0e3e43d7-8090-4989-a1fb-7566b0613dd1 service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1024.504398] env[69255]: INFO networking_nsxv3.common.synchronization [req-8b2fdb8f-ae07-4a24-8ede-b8172faa6974 req-0e3e43d7-8090-4989-a1fb-7566b0613dd1 service nova] Enqueued Resource ID: f3c0344c-b9bd-4bef-b933-ea4f960eb924 with Priority: HIGHEST for action port [ 1024.505204] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 1024.506038] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1024.507473] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c0344c-b9bd-4bef-b933-ea4f960eb924 with Priority: HIGHEST for action port [ 1024.507473] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.507473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.507473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.507473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.507473] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.510410] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.510410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.510410] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3c0344c-b9bd-4bef-b933-ea4f960eb924 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.510410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.510410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.510410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.510410] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c0344c-b9bd-4bef-b933-ea4f960eb924',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.647531] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1cc7026-1d45-4ec0-a32d-311a913b774a in Status: SUCCESS [ 1024.647724] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a deletion is rescheduled due to dependency. [ 1024.647843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.750144] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c2b23a-8e33-4b55-bd7f-88088c6e55c6: rpc.has_security_group_logging(os_id): False [ 1024.751669] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.780625] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.780787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.780839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.781119] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.781233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781469] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.781563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.781615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.781816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.781900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.782150] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.782285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.782401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.782617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.782739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.783739] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.783981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.784171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.784526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.784758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.785071] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be created. [ 1025.012217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.012217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.013516] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3c0344c-b9bd-4bef-b933-ea4f960eb924 with status ACTIVE [ 1025.015244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.015390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.015467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.015683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.015767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.015953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.016070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.016128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.016273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.016387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.017108] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.017108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.017108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.017108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.017466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.017466] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3c0344c-b9bd-4bef-b933-ea4f960eb924 is going to be updated. [ 1025.069590] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.069755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.069858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.070034] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.070217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.086776] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1025.094456] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.094652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.094718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.094978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.095144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.095329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3c0344c-b9bd-4bef-b933-ea4f960eb924" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.255058] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.431337] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1025.431628] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 1025.431732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.431908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.432171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.432358] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.432479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.432547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.432708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.432904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.432904] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.477062] env[69255]: INFO networking_nsxv3.common.synchronization [req-21c61dde-8075-4f45-80c3-c7a931e22b71 req-99f57d54-b5c2-40df-8f8a-811d1558ece9 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_members [ 1025.477618] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_members [ 1025.477933] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.478500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.478578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.478863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.479128] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.479128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.479342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.479394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.479463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.479558] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.632359] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 1025.632471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.757331] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.757550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.757550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.757887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.757887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.758058] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1025.787728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.787728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.787728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.788122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.788122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.796969] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1025.826516] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.826736] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.826868] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.827295] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.827582] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.827747] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.827870] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.828119] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.828278] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.828496] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.828614] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.828728] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.828840] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.828954] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.829076] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.829245] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.855424] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.855684] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.855762] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.855907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.856251] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-2afcc6c4-2ddd-439f-8113-4e123c6e1029 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.856435] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.856565] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.856916] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.857086] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2afcc6c4-2ddd-439f-8113-4e123c6e1029',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.935323] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.982261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.982261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.982261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.982495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.982577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.982808] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.982926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.983037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.983187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.983328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.983403] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a already deleted. [ 1025.983474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.359483] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.359948] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.359948] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.360201] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.360388] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.360564] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 2afcc6c4-2ddd-439f-8113-4e123c6e1029 not found, creating... [ 1026.360930] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.361126] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.361251] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.361510] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.361716] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.362045] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.362246] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.362380] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.362638] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.362784] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.362931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 2afcc6c4-2ddd-439f-8113-4e123c6e1029 is going to be created. [ 1026.384167] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.384382] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.384544] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.384816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.385356] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.385356] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.438403] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.941108] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.941281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.941329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.941549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.941645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.941747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1026.972618] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.973522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.973522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.973522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.973522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.981980] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1027.084229] env[69255]: INFO networking_nsxv3.common.synchronization [req-21c61dde-8075-4f45-80c3-c7a931e22b71 req-430ddcf5-d1b1-4af4-b0ed-6c5085529f8e service nova] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_rules [ 1027.084434] env[69255]: INFO networking_nsxv3.common.synchronization [req-21c61dde-8075-4f45-80c3-c7a931e22b71 req-430ddcf5-d1b1-4af4-b0ed-6c5085529f8e service nova] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_members [ 1027.085305] env[69255]: INFO networking_nsxv3.common.synchronization [req-21c61dde-8075-4f45-80c3-c7a931e22b71 req-430ddcf5-d1b1-4af4-b0ed-6c5085529f8e service nova] Enqueued Resource ID: 2afcc6c4-2ddd-439f-8113-4e123c6e1029 with Priority: HIGHEST for action port [ 1027.085305] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_rules [ 1027.085305] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_members [ 1027.085305] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2afcc6c4-2ddd-439f-8113-4e123c6e1029 with Priority: HIGHEST for action port [ 1027.085677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.085794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.085794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.085980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.086098] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.087276] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.087276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.087276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.087525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.087525] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.087607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.087680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.087863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.087901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.087994] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.089237] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2afcc6c4-2ddd-439f-8113-4e123c6e1029 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.089237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.089237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.091133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.091133] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2afcc6c4-2ddd-439f-8113-4e123c6e1029',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.103835] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1027.103835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.103835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.103835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.103835] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.595021] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.595021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.595021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2afcc6c4-2ddd-439f-8113-4e123c6e1029 with status ACTIVE [ 1027.595021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.595021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.595021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.595927] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.595927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.596132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.596467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.596702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.596898] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2afcc6c4-2ddd-439f-8113-4e123c6e1029 is going to be updated. [ 1027.606181] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.606181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.619268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.619268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.619268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.619268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.619268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.619268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2afcc6c4-2ddd-439f-8113-4e123c6e1029" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.807039] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1027.807354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.807534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.807763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.807957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.808100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.808160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.808306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.808388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.808473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.808564] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.099340] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.279604] env[69255]: INFO networking_nsxv3.common.synchronization [req-d70a288b-30b9-47a9-a612-0af1c48e6a29 req-1e385eb7-bcd3-4810-a6d6-6f75984b7b1c tempest-ListServersNegativeTestJSON-567248915 tempest-ListServersNegativeTestJSON-567248915-project-member] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1028.280182] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1028.280491] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.280607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.280671] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.280869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.281030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.281130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.281190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.281344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.281422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.281514] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.315257] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.315257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.601499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.601845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.601845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.602656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.602656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.602656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a is going to be created. [ 1028.627014] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.627227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.627227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.627447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.627614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.639108] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: UNINITIALIZED for 2s [ 1028.783715] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.991687] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1028.991967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.992150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.992360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.992548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.992677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.992729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.992868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.992933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.993017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.993113] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.286577] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.495817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.496047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.496047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.496287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.496450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.496592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.496631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.497079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.497157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.497228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.497382] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.497530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.497699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.497951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.498132] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.498385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.498516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.498782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.498888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.498981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.499089] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.790284] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.790284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.790829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.790829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.790829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.790931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1029.826512] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.826979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.827144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.827699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.827699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.839295] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1030.001144] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 1030.024500] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.024500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.024500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.024500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.024859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.024964] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.025116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.025312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.025441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.025596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.025872] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.026384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.026498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.026719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.026841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.027139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.027282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.027378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.027588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.027701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.027826] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1030.106633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.106988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.106988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.107220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.107426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.122895] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1030.128953] env[69255]: INFO networking_nsxv3.common.synchronization [req-a5617b9f-6078-420d-9e7c-34bce4d34013 req-acd9a8b8-fe09-40fe-aa07-02750b0e9a95 tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1030.128953] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1030.128953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.128953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.128953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.128953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.128953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.128953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.128953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.129596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.129596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.129943] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.168847] env[69255]: INFO networking_nsxv3.common.synchronization [req-a5617b9f-6078-420d-9e7c-34bce4d34013 req-acd9a8b8-fe09-40fe-aa07-02750b0e9a95 tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 1030.169071] env[69255]: INFO networking_nsxv3.common.synchronization [req-a5617b9f-6078-420d-9e7c-34bce4d34013 req-acd9a8b8-fe09-40fe-aa07-02750b0e9a95 tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1030.169224] env[69255]: INFO networking_nsxv3.common.synchronization [req-a5617b9f-6078-420d-9e7c-34bce4d34013 req-acd9a8b8-fe09-40fe-aa07-02750b0e9a95 tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with Priority: HIGHEST for action port [ 1030.169858] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 1030.170055] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1030.170174] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with Priority: HIGHEST for action port [ 1030.170503] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.170636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.170713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.170903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.170975] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.171935] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.172068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.172269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.172367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.172432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.172607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.172759] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec9eb2f4-f8a0-46d4-b9e9-37962984e75a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.433196] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d466079b-a13b-4b62-9adb-4f8dec0b5711 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 with Priority: HIGHEST for action security_group_rules [ 1030.433540] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 with Priority: HIGHEST for action security_group_rules [ 1030.433822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.433955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.434184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.434503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.434789] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac0980e7-b5f7-42b0-91ae-28585f1ac6d1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.457244] env[69255]: INFO networking_nsxv3.common.synchronization [req-fd335ef1-2c9f-4e29-9a0d-202bb1bdfba0 req-d0b4d0c7-e5e1-4a43-b02a-3aecbfba579a tempest-ImagesTestJSON-1624745968 tempest-ImagesTestJSON-1624745968-project-member] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 1030.457798] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGHEST for action security_group_members [ 1030.459164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.459164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.459331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.459601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.459816] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.459980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.460109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.460420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.460592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.460805] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.516312] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f5830709-1e5a-4508-a00a-bf699df0fe93 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 with Priority: HIGHEST for action security_group_rules [ 1030.516856] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 with Priority: HIGHEST for action security_group_rules [ 1030.517192] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.517283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.632590] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.649983] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: SUCCESS [ 1030.649983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.649983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.649983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.650142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.650142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.650231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.650462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.650462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.650641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.650641] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.674042] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.674269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.674363] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with status ACTIVE [ 1030.674538] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.674642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.674701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.674895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.674981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.675171] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.675287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.675363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.675523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.675600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.675803] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.676341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.676341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.676341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.676341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.676341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a is going to be updated. [ 1030.699834] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.699834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.699834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.700211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.700211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.700211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.957429] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.957898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.957898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.957898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.958129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.958129] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 already deleted. [ 1030.958129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.958284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.958413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.958496] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac0980e7-b5f7-42b0-91ae-28585f1ac6d1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.963181] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.963306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.963366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.963538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.963622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.963802] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.963896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.963955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.964112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.964183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.964268] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be updated. [ 1030.994917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.995274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.995274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.995429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.995498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.012956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: IN_PROGRESS for 2s [ 1031.137824] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.153309] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.486735] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.486992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.486992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.487199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.487294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.487395] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac0980e7-b5f7-42b0-91ae-28585f1ac6d1 already deleted. [ 1031.487478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac0980e7-b5f7-42b0-91ae-28585f1ac6d1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.640038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.643635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.643635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.643635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.643635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.643635] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be updated. [ 1031.656449] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f15aa0e7-20c8-41cc-a9da-af90fc09095a: rpc.has_security_group_logging(os_id): False [ 1031.678249] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.678438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.678505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.678702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.678796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.679062] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.679193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.679259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.679442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.679556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.679641] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a is going to be created. [ 1031.693283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.693455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.693508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.693877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.694204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.707217] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: IN_PROGRESS for 2s [ 1031.773269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.773496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.773496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.773688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.773926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.789879] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: IN_PROGRESS for 2s [ 1031.872941] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1031.873156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.873326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.873615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.874181] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.874181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.874181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.874181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.874395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.874395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.874480] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.874539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.874580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.874727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.874948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.875321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.875438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.875638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.875760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.875890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.876228] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.139387] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1032.139764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.378637] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c2b23a-8e33-4b55-bd7f-88088c6e55c6: rpc.has_security_group_logging(os_id): False [ 1032.396998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.397209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.397255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.397459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.397549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.397819] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.397927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.397993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.398182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.398304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.398520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.398621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.398705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.398915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.399030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.399295] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.399421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.399488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.399691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.399854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.399949] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1032.463886] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.463886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.463886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.466058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.466058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.479165] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1032.879637] env[69255]: INFO networking_nsxv3.common.synchronization [req-4d3eed46-dac7-4ed2-a420-bcaa5f15a39d req-95ffbbcc-6eb2-4320-bbb5-ad4187c14b8a tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1032.880752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1032.881194] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.881322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.896417] env[69255]: INFO networking_nsxv3.common.synchronization [req-4d3eed46-dac7-4ed2-a420-bcaa5f15a39d req-95ffbbcc-6eb2-4320-bbb5-ad4187c14b8a tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 1032.896417] env[69255]: INFO networking_nsxv3.common.synchronization [req-4d3eed46-dac7-4ed2-a420-bcaa5f15a39d req-95ffbbcc-6eb2-4320-bbb5-ad4187c14b8a tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1032.896502] env[69255]: INFO networking_nsxv3.common.synchronization [req-4d3eed46-dac7-4ed2-a420-bcaa5f15a39d req-95ffbbcc-6eb2-4320-bbb5-ad4187c14b8a tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with Priority: HIGHEST for action port [ 1032.899636] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_rules [ 1032.899636] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1032.899636] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with Priority: HIGHEST for action port [ 1032.899636] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.899636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.899636] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.899636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.899636] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.899636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.899636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.899636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.899636] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec9eb2f4-f8a0-46d4-b9e9-37962984e75a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.023407] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 in Status: SUCCESS [ 1033.023600] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 deletion is rescheduled due to dependency. [ 1033.023705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.401691] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec9eb2f4-f8a0-46d4-b9e9-37962984e75a with status ACTIVE [ 1033.402050] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.402337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.402465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.402718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.402837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.403076] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.403376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.403509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.403684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.403764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.403960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.404101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.404180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.404344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.404400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.405170] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec9eb2f4-f8a0-46d4-b9e9-37962984e75a is going to be updated. [ 1033.427598] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.427778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.429142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.429738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.429947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.430171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec9eb2f4-f8a0-46d4-b9e9-37962984e75a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.717519] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 1033.717791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.717970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.718206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.718428] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.718616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.718616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.718735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.718790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.718905] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.803484] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: SUCCESS [ 1033.803983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.962325] env[69255]: INFO networking_nsxv3.common.synchronization [req-10b33285-ec2d-4a0d-9b5b-fde4fbd11557 req-81b89293-dfa5-48d2-87e6-6639a0a11ac6 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1033.962959] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1033.963223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.964181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.964181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.964181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.964181] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.964181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.964181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.964645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.964645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.964645] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.221700] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.471088] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.471446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.471446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.471536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.471647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.471867] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.472031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.472099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.472275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.472391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.472565] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1034.494151] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1034.494387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.495120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.495120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.495120] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.507701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.507701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.507701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.507701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.507701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.517153] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1034.723632] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.997633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.997820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.997885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.998114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.998294] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.998493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.998493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.998607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.998686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.998775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.998887] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.225990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.226316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.226397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.226882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.227118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.227286] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be updated. [ 1035.275117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.275360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.275360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.275579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.275690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.285832] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: IN_PROGRESS for 2s [ 1035.501285] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.504555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.504555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.504555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.504555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.505339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.505339] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.008368] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48c2b23a-8e33-4b55-bd7f-88088c6e55c6: rpc.has_security_group_logging(os_id): False [ 1036.025344] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.025499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.025568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.025782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.025867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.026096] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.026245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.026291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.026411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.026488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.026671] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.026769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.026824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.026948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.027033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.027208] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.027300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.027360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.027507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.027589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.027684] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1036.087601] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.087819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.087819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.088040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.088567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.103758] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1036.528081] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1036.528081] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 1036.528429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.630157] env[69255]: INFO networking_nsxv3.common.synchronization [req-ea2909fb-3aba-4335-8e13-a24e20048612 req-dab886bb-9779-4111-bf04-f79616e9a66e tempest-AttachInterfacesUnderV243Test-842188126 tempest-AttachInterfacesUnderV243Test-842188126-project-member] Enqueued Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1036.630674] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 with Priority: HIGHEST for action security_group_members [ 1036.632063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.632063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.302021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.302021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.302021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.302021] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.303291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.309076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.309076] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.309076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.309076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.309076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.309076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.309076] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.581461] env[69255]: INFO networking_nsxv3.common.synchronization [req-65e6f996-24c2-451b-afd1-ce5698b0602a req-8a704a7d-37c7-47c3-82ed-841206927f38 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1037.582537] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1037.583489] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.583774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.583959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.584325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.584600] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.584815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.584963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.585218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.585419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.585611] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.807261] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.812714] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.812714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.812714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.812714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.812714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.813268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.813268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.813268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.813268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.813268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.813747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be updated. [ 1037.862572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.862819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.862819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.863035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.863178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.873973] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: IN_PROGRESS for 2s [ 1038.087989] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.088196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.088314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.088461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.088547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.088823] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.088954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.088954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.089098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.089162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.089222] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1038.118834] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1038.119078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.125092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.125187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.125233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.125434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.125582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.137577] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1038.313923] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2: rpc.has_security_group_logging(os_id): False [ 1038.333376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.333586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.333586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.333798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.333899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.334163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.334267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.334339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.334492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.334569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.334656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be updated. [ 1038.395111] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.395270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.395341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.395564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.395712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.408900] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: IN_PROGRESS for 2s [ 1039.887276] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 1039.887599] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 deletion is rescheduled due to dependency. [ 1039.887599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.887765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.888065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.888275] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.888411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.888478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.888648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.888732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.888829] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.149824] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1040.149824] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 1040.149824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.393024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.393024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.393024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.393024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be updated. [ 1040.418892] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.419054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.419128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.419384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.419535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.427520] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 1040.427758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.427938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.428194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.428278] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.430105] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: IN_PROGRESS for 2s [ 1040.872403] env[69255]: INFO networking_nsxv3.common.synchronization [req-0f426456-aa6e-4854-9d5a-712c0ddc2c05 req-d5f81331-737c-4ba9-b991-9d128529039c tempest-ServerTagsTestJSON-1497997195 tempest-ServerTagsTestJSON-1497997195-project-member] Enqueued Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_members [ 1040.872915] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_members [ 1040.873233] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.873352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.873416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.873679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.873833] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.873932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.873988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.874186] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.874271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.874363] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.948128] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.948476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.948476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.948637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.948695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.948803] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be deleted. [ 1040.999469] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.999655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.999766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.999883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.999978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.000293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.177101] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.177356] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-196" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.177496] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-196" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.177870] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-196" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.180022] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.180022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.180022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.180420] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.180684] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.180942] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.181115] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.181247] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.181379] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.181519] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.181639] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.181804] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.199463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.200432] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.200432] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.200432] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-196" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.200432] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-558d677b-1652-4d57-82a7-d22d1779ccb9 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.200759] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.200759] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.201109] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.201281] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('558d677b-1652-4d57-82a7-d22d1779ccb9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.376401] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.376648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.376648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.376863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.376943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.377191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.377323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.377418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.377524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.377608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.377682] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 already deleted. [ 1041.377753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.704061] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.704061] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.704265] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.704486] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.704647] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.704808] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 558d677b-1652-4d57-82a7-d22d1779ccb9 not found, creating... [ 1041.705158] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.705354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.705482] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.705748] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.705899] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.706213] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.706454] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.706516] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.706719] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.706861] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.707015] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 558d677b-1652-4d57-82a7-d22d1779ccb9 is going to be created. [ 1041.726937] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.727254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.727407] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.727683] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.727920] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.728172] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.463327] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 in Status: SUCCESS [ 1042.463327] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 deletion is rescheduled due to dependency. [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.463327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.463327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.463327] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a3fe7b6-e2cf-426a-92ff-39e176a24eb2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.504382] env[69255]: INFO networking_nsxv3.common.synchronization [req-0f426456-aa6e-4854-9d5a-712c0ddc2c05 req-3882217f-8655-455d-b49c-04c4c8319175 service nova] Enqueued Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_rules [ 1042.504382] env[69255]: INFO networking_nsxv3.common.synchronization [req-0f426456-aa6e-4854-9d5a-712c0ddc2c05 req-3882217f-8655-455d-b49c-04c4c8319175 service nova] Enqueued Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_members [ 1042.504382] env[69255]: INFO networking_nsxv3.common.synchronization [req-0f426456-aa6e-4854-9d5a-712c0ddc2c05 req-3882217f-8655-455d-b49c-04c4c8319175 service nova] Enqueued Resource ID: 558d677b-1652-4d57-82a7-d22d1779ccb9 with Priority: HIGHEST for action port [ 1042.504382] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_rules [ 1042.504382] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_members [ 1042.504382] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558d677b-1652-4d57-82a7-d22d1779ccb9 with Priority: HIGHEST for action port [ 1042.504382] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.504382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.504382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.504382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.505030] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.507497] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.508107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.508305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.508587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.509168] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.509457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.509636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.510040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.510247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.510443] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.511906] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-558d677b-1652-4d57-82a7-d22d1779ccb9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.512632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.512632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.512632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.512632] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('558d677b-1652-4d57-82a7-d22d1779ccb9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.742166] env[69255]: INFO networking_nsxv3.common.synchronization [req-4b12fbd7-fb52-4bcf-a763-08ac6377097b req-ec580ea5-14b9-4afc-bf3d-fabe200ed10f tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_members [ 1042.742897] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGHEST for action security_group_members [ 1042.742971] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.743069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.743126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.743330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.743474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.743565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.743625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.743762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.743848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.743934] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.948940] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.949140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.949279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.949468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.949558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.949757] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.949859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.949923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.950087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.950170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.950565] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a3fe7b6-e2cf-426a-92ff-39e176a24eb2 is going to be deleted. [ 1042.982784] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.983066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.983066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.983219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.983314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.983413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a3fe7b6-e2cf-426a-92ff-39e176a24eb2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.012919] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.017945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 558d677b-1652-4d57-82a7-d22d1779ccb9 with status ACTIVE [ 1043.017945] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.018152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.018152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.018437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.018540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.018649] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.018746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.018808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.018997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.019047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.019291] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.019430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.019512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.019698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.019806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.019947] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 558d677b-1652-4d57-82a7-d22d1779ccb9 is going to be updated. [ 1043.021246] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.021347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.041944] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.042877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.042877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.042877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.042877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.042877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-558d677b-1652-4d57-82a7-d22d1779ccb9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.239751] env[69255]: INFO networking_nsxv3.common.synchronization [req-69d878fc-9702-468b-b788-6a383bd56e65 req-42f998aa-b0f4-45e8-bbe7-89770ce2f9f1 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_members [ 1043.240722] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_members [ 1043.240870] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.240995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.241078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.241339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.241499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.241601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.241662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.241812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.241898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.241989] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.246823] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.246942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.247018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.247440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.247440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.247440] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.247591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.247591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.247719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.247794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.247880] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d is going to be updated. [ 1043.283751] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.283921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.284013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.284272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.284432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.294038] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d in Status: IN_PROGRESS for 2s [ 1043.518020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.526520] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.526709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.526838] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.527149] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.527408] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.527567] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.527995] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.527995] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.528146] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.528282] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.528430] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.528547] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.528659] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.528773] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1043.528884] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.529144] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.547894] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.549314] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1043.551702] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.551702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.551702] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-10233e71-1df7-47c5-a814-77c4fe936f65 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.551702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.551702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.551702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.551702] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10233e71-1df7-47c5-a814-77c4fe936f65',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.744523] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.744686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.744746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.744971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.745086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.745288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.745383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.745443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.745611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.745682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.745769] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 already deleted. [ 1043.745849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.023436] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.023436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.023436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.023436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.023436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.023436] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 is going to be created. [ 1044.047922] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.047922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.047922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.047922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.047922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.055337] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.055337] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 10233e71-1df7-47c5-a814-77c4fe936f65 not found, creating... [ 1044.055337] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.055337] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.058362] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.058362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.058362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.058362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.058362] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.058362] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 10233e71-1df7-47c5-a814-77c4fe936f65 is going to be created. [ 1044.060276] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 in Status: UNINITIALIZED for 2s [ 1044.083475] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.083682] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.083814] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.084122] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.084369] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.084599] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.762089] env[69255]: INFO networking_nsxv3.common.synchronization [req-69d878fc-9702-468b-b788-6a383bd56e65 req-deae3244-6971-4c5f-a078-9f6a5b4b369a service nova] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_rules [ 1044.762465] env[69255]: INFO networking_nsxv3.common.synchronization [req-69d878fc-9702-468b-b788-6a383bd56e65 req-deae3244-6971-4c5f-a078-9f6a5b4b369a service nova] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_members [ 1044.762638] env[69255]: INFO networking_nsxv3.common.synchronization [req-69d878fc-9702-468b-b788-6a383bd56e65 req-deae3244-6971-4c5f-a078-9f6a5b4b369a service nova] Enqueued Resource ID: 10233e71-1df7-47c5-a814-77c4fe936f65 with Priority: HIGHEST for action port [ 1044.762877] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_rules [ 1044.763011] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_members [ 1044.763114] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10233e71-1df7-47c5-a814-77c4fe936f65 with Priority: HIGHEST for action port [ 1044.763646] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.763772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.763840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.764861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.764985] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.765847] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.765975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.766040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.766221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.766377] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.766498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.766559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.766705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.766803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.766895] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.768532] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-10233e71-1df7-47c5-a814-77c4fe936f65 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.768532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.768532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.768685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.768715] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10233e71-1df7-47c5-a814-77c4fe936f65',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.270875] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.271039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.272411] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.273291] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10233e71-1df7-47c5-a814-77c4fe936f65 with status ACTIVE [ 1045.273568] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.273687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.273754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.273958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.274076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.274256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.274366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.274430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.274584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.274660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.274837] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.274927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.274987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.275137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.275213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.275295] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10233e71-1df7-47c5-a814-77c4fe936f65 is going to be updated. [ 1045.297260] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.297420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.297420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.297622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.297767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.297927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10233e71-1df7-47c5-a814-77c4fe936f65" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.303684] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d in Status: SUCCESS [ 1045.303857] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d deletion is rescheduled due to dependency. [ 1045.303966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.778256] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.071330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 in Status: SUCCESS [ 1046.071589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.071748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.071971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.072184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.072310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.072377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.072533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.072616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.072702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.072794] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.281549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.281797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.281861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.282099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.282370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.282497] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 is going to be created. [ 1046.305448] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.305448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.305448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.305448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.305448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.316483] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: UNINITIALIZED for 2s [ 1046.576516] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.576737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.576865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.577163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.577383] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.577493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.577576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.577765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.577856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.578287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.578287] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.578287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.578287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.578509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.578561] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.578633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.578759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.578811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.578910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.579041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.579152] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.081214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b2274cf-1b64-4aa8-86d7-1976f121d239: rpc.has_security_group_logging(os_id): False [ 1047.101113] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.101299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.101367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.101962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.101962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.101962] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.101962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.102140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.102168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.102254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.102411] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.102509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.102604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.102752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.102825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.103101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.103212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.103261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.103402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.103474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.103560] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 is going to be created. [ 1047.165606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.165827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.165861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.166518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.166749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.181401] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 in Status: IN_PROGRESS for 2s [ 1048.327838] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: SUCCESS [ 1048.328168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.328350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.328848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.328848] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.329021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.329135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.329340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.329473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.329615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.329715] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.832306] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.196763] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 in Status: SUCCESS [ 1049.197047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.340565] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91d1981f-899d-44d8-9b18-06e5c0499d68: rpc.has_security_group_logging(os_id): False [ 1049.360728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.360993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.361734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.361734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.361734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.362037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.362211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.362290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.362538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.363334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.363334] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 is going to be created. [ 1049.447460] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.447660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.447714] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.448039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.448250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.459371] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: IN_PROGRESS for 2s [ 1049.764468] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1049.764468] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1050.095144] env[69255]: INFO networking_nsxv3.common.synchronization [req-e89b5911-6468-4e1f-b4fa-4c3372309508 req-d23372c3-cc52-4ac0-8129-3f3e9b2b18c4 tempest-ServerRescueNegativeTestJSON-359327338 tempest-ServerRescueNegativeTestJSON-359327338-project-member] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 1050.095144] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGHEST for action security_group_members [ 1050.095144] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.095144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.095144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.095144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.095144] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.095144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.095144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.099492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.100280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.100280] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.603672] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.604049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.604049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.604170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.630381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.630645] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.630770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.630874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.631047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.631128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.631226] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be updated. [ 1050.661281] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.661450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.661531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.661784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.661982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.673301] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: IN_PROGRESS for 2s [ 1051.304708] env[69255]: INFO networking_nsxv3.common.synchronization [req-7a70953c-63f0-484d-abce-0eb41d68efc1 req-c3a1fec7-4821-49c0-9d45-ba6deb791332 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1051.305274] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1051.305582] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.305710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.305777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.305978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.308325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.308452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.308521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.308710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.308815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.308917] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.471362] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: SUCCESS [ 1051.471675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.521038] env[69255]: INFO networking_nsxv3.common.synchronization [req-85bfa4bc-789a-4b39-af67-6cd6088b847c req-a48ee750-a50b-4d70-8478-2591cb275270 tempest-ListServersNegativeTestJSON-567248915 tempest-ListServersNegativeTestJSON-567248915-project-member] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1051.521474] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1051.521880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.522572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.522572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.522766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.522980] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.523344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.523344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.523467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.523639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.523789] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.550941] env[69255]: INFO networking_nsxv3.common.synchronization [req-d33f51eb-a588-465b-88cc-a047e6942e4d req-e7204136-f757-4d0f-b40c-1df92a0e433b tempest-ListServersNegativeTestJSON-567248915 tempest-ListServersNegativeTestJSON-567248915-project-member] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1051.551497] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGHEST for action security_group_members [ 1051.551812] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.551918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.813215] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.813514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.813514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.813938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.814115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.814377] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.814503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.814577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.814746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.814849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.814952] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1051.843853] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.844045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.844152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.844347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.844520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.857867] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1051.869787] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.870057] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.870196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.870478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.870755] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.870914] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.871072] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.871303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.871457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.871688] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.871813] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.871929] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.872051] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.872168] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.872278] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.872425] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.891363] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.891616] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.891689] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.891874] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.892204] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.892380] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.892504] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.892854] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.893008] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aed1f2e-f140-47e8-8e03-3de9fd9d3908',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.027676] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.027676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.027676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.027846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.027846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.027977] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.028082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.028142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.028291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.029058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.029058] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1052.067662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.068060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.068060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.068148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.068275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.081985] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1052.398963] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.399345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.399827] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.399827] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.399969] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.400058] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5aed1f2e-f140-47e8-8e03-3de9fd9d3908 not found, creating... [ 1052.400401] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.400507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.401120] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.401120] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.401120] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.403986] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.403986] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.403986] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.403986] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.403986] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.404380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5aed1f2e-f140-47e8-8e03-3de9fd9d3908 is going to be created. [ 1052.428439] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.429352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.429352] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.429473] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.429673] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.429932] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.684448] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a228003c-531a-43cb-9396-964ab52c0831 in Status: SUCCESS [ 1052.684631] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a228003c-531a-43cb-9396-964ab52c0831 deletion is rescheduled due to dependency. [ 1052.684751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.301666] env[69255]: INFO networking_nsxv3.common.synchronization [req-7a70953c-63f0-484d-abce-0eb41d68efc1 req-88ef2022-d166-4bcb-bf22-5cd9b8e1d8ee service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 1053.301974] env[69255]: INFO networking_nsxv3.common.synchronization [req-7a70953c-63f0-484d-abce-0eb41d68efc1 req-88ef2022-d166-4bcb-bf22-5cd9b8e1d8ee service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1053.301974] env[69255]: INFO networking_nsxv3.common.synchronization [req-7a70953c-63f0-484d-abce-0eb41d68efc1 req-88ef2022-d166-4bcb-bf22-5cd9b8e1d8ee service nova] Enqueued Resource ID: 5aed1f2e-f140-47e8-8e03-3de9fd9d3908 with Priority: HIGHEST for action port [ 1053.302240] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 1053.302372] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1053.302469] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aed1f2e-f140-47e8-8e03-3de9fd9d3908 with Priority: HIGHEST for action port [ 1053.303341] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.303496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.303566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.303954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.304065] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.305325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.305492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.305620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.305723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.305791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.305963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.306207] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aed1f2e-f140-47e8-8e03-3de9fd9d3908',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.715232] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7366911c-750a-43b3-9180-f1ee7945ea1f None None] Enqueued Resource ID: f619ed5b-f005-4e8e-be6a-3f2bf5deea30 with Priority: HIGHEST for action port [ 1053.715232] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f619ed5b-f005-4e8e-be6a-3f2bf5deea30 with Priority: HIGHEST for action port [ 1053.715232] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f619ed5b-f005-4e8e-be6a-3f2bf5deea30 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.715232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f619ed5b-f005-4e8e-be6a-3f2bf5deea30" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.715232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f619ed5b-f005-4e8e-be6a-3f2bf5deea30" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.715232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f619ed5b-f005-4e8e-be6a-3f2bf5deea30" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.715646] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f619ed5b-f005-4e8e-be6a-3f2bf5deea30',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.809082] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.809249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.809507] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aed1f2e-f140-47e8-8e03-3de9fd9d3908 with status ACTIVE [ 1053.809775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.809902] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.809955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.810208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.810301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.810483] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.810581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.810642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.810793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.811275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.811686] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.814526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.814526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.814526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.814526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.814526] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aed1f2e-f140-47e8-8e03-3de9fd9d3908 is going to be updated. [ 1053.838069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.838069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.838069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.838069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.838069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.838069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aed1f2e-f140-47e8-8e03-3de9fd9d3908" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.872025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1053.872025] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.872025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.872025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.872025] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.092169] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1054.092169] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 deletion is rescheduled due to dependency. [ 1054.092169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.092169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.092558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.092721] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.092850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.092904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.093182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.093182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.093767] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.220165] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f619ed5b-f005-4e8e-be6a-3f2bf5deea30 [ 1054.220402] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.220539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.220610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.220837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.220926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.221049] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f619ed5b-f005-4e8e-be6a-3f2bf5deea30 already deleted. [ 1054.221133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f619ed5b-f005-4e8e-be6a-3f2bf5deea30" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.376074] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.596505] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.596610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.596701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.597030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597450] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.597835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be updated. [ 1054.621986] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.622266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.622266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.622426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.622567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.632975] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: IN_PROGRESS for 2s [ 1054.879452] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.383894] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.384258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.384795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.385083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.386761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.386761] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1055.418749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.419031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.419031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.419244] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.419398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.430950] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1055.726338] env[69255]: INFO networking_nsxv3.common.synchronization [req-7b96f9f6-49c5-4f04-aa2d-09f5d4ca4008 req-09845920-023c-400c-a198-db607169f80b tempest-ServerTagsTestJSON-1497997195 tempest-ServerTagsTestJSON-1497997195-project-member] Enqueued Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_members [ 1055.729454] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGHEST for action security_group_members [ 1055.729454] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.729454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.729454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.729454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.729454] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.729454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.729454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.729889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.729889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.729889] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.232021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.232365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.232483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.232854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.232854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.233188] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.233292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.233354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.233512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.233592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.233683] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 is going to be updated. [ 1056.271806] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.272014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.272097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.272394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.272639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.283174] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 in Status: IN_PROGRESS for 2s [ 1056.648249] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 in Status: SUCCESS [ 1056.648249] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 deletion is rescheduled due to dependency. [ 1056.648249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.737378] env[69255]: INFO networking_nsxv3.common.synchronization [None req-859971f2-7f5d-4cc4-930b-611912c8a718 None None] Enqueued Resource ID: cf77dbd8-9c2f-419e-94e5-a32addc56040 with Priority: HIGHEST for action port [ 1056.738241] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf77dbd8-9c2f-419e-94e5-a32addc56040 with Priority: HIGHEST for action port [ 1056.738633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf77dbd8-9c2f-419e-94e5-a32addc56040 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.738928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf77dbd8-9c2f-419e-94e5-a32addc56040" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.739023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf77dbd8-9c2f-419e-94e5-a32addc56040" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.739358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf77dbd8-9c2f-419e-94e5-a32addc56040" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.739474] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf77dbd8-9c2f-419e-94e5-a32addc56040',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.809933] env[69255]: INFO networking_nsxv3.common.synchronization [req-fcc17a17-69a1-4b4c-9ce3-5d1806add15a req-72671bf9-90c7-4b80-9e59-a89a33ca6c96 tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1056.810359] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1056.810698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.810820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.810948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.814175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.814360] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.814509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.814582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.814794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.814882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.814981] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.243308] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf77dbd8-9c2f-419e-94e5-a32addc56040 [ 1057.243308] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.243308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.243308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.243308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.243308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.243308] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf77dbd8-9c2f-419e-94e5-a32addc56040 already deleted. [ 1057.243308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf77dbd8-9c2f-419e-94e5-a32addc56040" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.317973] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.317973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.317973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.317973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.317973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.318178] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.318178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.318250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.318374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.318450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.318611] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1057.348816] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.348962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.349048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.349260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.349404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.360920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1057.441934] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1057.442165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.442336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.442558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.442777] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.442908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.442962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.443156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.443245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.443340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.443404] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.519971] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.519971] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.519971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.520394] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.520523] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.520693] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.520833] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.520982] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1057.521212] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.521402] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.547288] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.547288] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1057.547288] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.547288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-436" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.547288] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.547288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.548507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.548887] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.549713] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e90fcec-b154-47eb-a5c8-de2d6bbaa349',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.596500] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.596500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.596500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.596500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.596500] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.950099] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.951171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.951171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.952145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.952145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.952145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.955020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.955020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.955020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.955020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.054924] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.055258] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.055509] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.055856] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.056091] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.056283] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 7e90fcec-b154-47eb-a5c8-de2d6bbaa349 not found, creating... [ 1058.056609] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.056881] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.056998] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.057296] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.059093] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.059580] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.059757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.059882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.060140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.060290] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.060443] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 7e90fcec-b154-47eb-a5c8-de2d6bbaa349 is going to be created. [ 1058.081763] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.082032] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.082163] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.083049] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.083049] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.083049] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.098524] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.297016] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 in Status: SUCCESS [ 1058.297016] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 deletion is rescheduled due to dependency. [ 1058.297016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.458944] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 981734c6-752d-40c2-ba2a-3f068cd82111: rpc.has_security_group_logging(os_id): False [ 1058.478495] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.481146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.481146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.482486] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.482486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.482761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.482761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.482761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.483032] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.483118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.483155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.483310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.483383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.483513] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1058.551673] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.551673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.551673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.551673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.551673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.568968] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1058.601718] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.897693] env[69255]: INFO networking_nsxv3.common.synchronization [req-945e60e3-a8b3-4294-aad3-582bba71f5c9 req-eca3e8ae-6fdf-4e37-931a-f5032e0a56b3 tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: af2b2e10-01f3-4e08-9a4f-1b5974f0194f with Priority: HIGHEST for action security_group_rules [ 1058.898526] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af2b2e10-01f3-4e08-9a4f-1b5974f0194f with Priority: HIGHEST for action security_group_rules [ 1058.899145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af2b2e10-01f3-4e08-9a4f-1b5974f0194f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.899513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af2b2e10-01f3-4e08-9a4f-1b5974f0194f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.899741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af2b2e10-01f3-4e08-9a4f-1b5974f0194f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.901472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af2b2e10-01f3-4e08-9a4f-1b5974f0194f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.901472] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af2b2e10-01f3-4e08-9a4f-1b5974f0194f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.052959] env[69255]: INFO networking_nsxv3.common.synchronization [None req-972278fc-7d0f-4a2d-b19f-6d98faf04daf None None] Enqueued Resource ID: 577210f0-fecc-473d-b72e-05cac23ed821 with Priority: HIGHEST for action port [ 1059.053543] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 577210f0-fecc-473d-b72e-05cac23ed821 with Priority: HIGHEST for action port [ 1059.054038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-577210f0-fecc-473d-b72e-05cac23ed821 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.054276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-577210f0-fecc-473d-b72e-05cac23ed821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.054372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-577210f0-fecc-473d-b72e-05cac23ed821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.056147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-577210f0-fecc-473d-b72e-05cac23ed821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.056221] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('577210f0-fecc-473d-b72e-05cac23ed821',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.058875] env[69255]: INFO networking_nsxv3.common.synchronization [None req-27c9cdd8-04ce-4f32-b4de-218f68598806 None None] Enqueued Resource ID: 01a32238-e655-4ab0-9d1c-b53f784572d9 with Priority: HIGHEST for action port [ 1059.059355] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a32238-e655-4ab0-9d1c-b53f784572d9 with Priority: HIGHEST for action port [ 1059.059975] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-01a32238-e655-4ab0-9d1c-b53f784572d9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.060267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01a32238-e655-4ab0-9d1c-b53f784572d9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.060364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01a32238-e655-4ab0-9d1c-b53f784572d9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.061193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01a32238-e655-4ab0-9d1c-b53f784572d9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.061361] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01a32238-e655-4ab0-9d1c-b53f784572d9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.103339] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1059.103459] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1059.109992] env[69255]: INFO networking_nsxv3.common.synchronization [req-fcc17a17-69a1-4b4c-9ce3-5d1806add15a req-ad3440fb-12a5-4eab-a99c-8e95a2b49b4d service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 1059.110185] env[69255]: INFO networking_nsxv3.common.synchronization [req-fcc17a17-69a1-4b4c-9ce3-5d1806add15a req-ad3440fb-12a5-4eab-a99c-8e95a2b49b4d service nova] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1059.110324] env[69255]: INFO networking_nsxv3.common.synchronization [req-fcc17a17-69a1-4b4c-9ce3-5d1806add15a req-ad3440fb-12a5-4eab-a99c-8e95a2b49b4d service nova] Enqueued Resource ID: 7e90fcec-b154-47eb-a5c8-de2d6bbaa349 with Priority: HIGHEST for action port [ 1059.110836] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_rules [ 1059.110983] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1059.112037] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e90fcec-b154-47eb-a5c8-de2d6bbaa349 with Priority: HIGHEST for action port [ 1059.112444] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.113683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.113950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.114270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.114752] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.118729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.118868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.119138] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.119272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.119307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.119550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.119636] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e90fcec-b154-47eb-a5c8-de2d6bbaa349',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.324423] env[69255]: INFO networking_nsxv3.common.synchronization [req-d55109ce-9758-4d9b-93fa-132c2e0b4825 req-cbe86061-87df-48db-b3ce-3bb291f4fd8f tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: d5efd9cf-286f-4c58-8dad-6d918a9ed8ee with Priority: HIGHEST for action security_group_rules [ 1059.326959] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5efd9cf-286f-4c58-8dad-6d918a9ed8ee with Priority: HIGHEST for action security_group_rules [ 1059.326959] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5efd9cf-286f-4c58-8dad-6d918a9ed8ee taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.326959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5efd9cf-286f-4c58-8dad-6d918a9ed8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.326959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5efd9cf-286f-4c58-8dad-6d918a9ed8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.326959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5efd9cf-286f-4c58-8dad-6d918a9ed8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.326959] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5efd9cf-286f-4c58-8dad-6d918a9ed8ee',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.373282] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1059.373472] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 1059.373798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.374053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.374293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.374473] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.374596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.374696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.374829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.374956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.375052] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.432149] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.432394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.432454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.432663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.432922] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.433101] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af2b2e10-01f3-4e08-9a4f-1b5974f0194f already deleted. [ 1059.433257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af2b2e10-01f3-4e08-9a4f-1b5974f0194f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.566112] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 577210f0-fecc-473d-b72e-05cac23ed821 [ 1059.566112] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.566112] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:577210f0-fecc-473d-b72e-05cac23ed821 already deleted. [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-577210f0-fecc-473d-b72e-05cac23ed821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.566112] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01a32238-e655-4ab0-9d1c-b53f784572d9 [ 1059.566112] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.566112] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01a32238-e655-4ab0-9d1c-b53f784572d9 already deleted. [ 1059.566112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01a32238-e655-4ab0-9d1c-b53f784572d9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.624043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.624043] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e90fcec-b154-47eb-a5c8-de2d6bbaa349 with status ACTIVE [ 1059.624043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.624043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.624043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.624043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.624844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.624844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.624844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.624844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.624844] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e90fcec-b154-47eb-a5c8-de2d6bbaa349 is going to be updated. [ 1059.654822] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.654822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.654822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.654822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.655262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.655262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e90fcec-b154-47eb-a5c8-de2d6bbaa349" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.860908] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.861058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.861131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.861335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.861424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.861521] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5efd9cf-286f-4c58-8dad-6d918a9ed8ee already deleted. [ 1059.861603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5efd9cf-286f-4c58-8dad-6d918a9ed8ee" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.878155] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.078330] env[69255]: INFO networking_nsxv3.common.synchronization [req-fc6a4ed2-be13-49f0-b6c9-258d5934e043 req-37d5e28d-6732-42dd-b33e-dcaf9f57e246 tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf with Priority: HIGHEST for action security_group_rules [ 1060.078935] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf with Priority: HIGHEST for action security_group_rules [ 1060.079395] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.079395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.079523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.079983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.079983] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.279202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.279393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.279441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.279670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.297821] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1060.303028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.303028] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1060.342948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.342948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.342948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.342948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.364478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.365869] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1060.366102] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1060.366228] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1060.385053] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.425929] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.425929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.425929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.425929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.426263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.427483] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1060.510775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.510961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.511067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.511263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.511577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.511904] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1060.559966] env[69255]: INFO networking_nsxv3.common.synchronization [None req-e86a860f-b20f-495b-ae10-f21ed36cf1da tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1060.561032] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1060.561032] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.561032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.564202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.564686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.564686] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.590613] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.590816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.590816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.590940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.591262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.591538] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1060.591634] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'48c2b23a-8e33-4b55-bd7f-88088c6e55c6', 'd9a73172-9297-4dba-844d-93ad67b908a4', 'd629ccb4-175d-4e83-941e-35fb3996c7a9', 'cd8fc5f6-8c57-4558-8b42-ae2373cea267', 'd8f8404c-0625-4de4-9522-49bae286c6f7', '48fa580c-2432-422e-a13f-1995d2283ac0', 'a228003c-531a-43cb-9396-964ab52c0831', '2623f063-14bb-4aff-bf17-71443391d8f7', 'cf245b92-395b-436b-927d-80e3a468ef38', '5d36f190-eca4-498f-b2be-5b1977c816d8', '39f23576-868c-480d-b556-0aad9680f300', '91d1981f-899d-44d8-9b18-06e5c0499d68', 'd24a10fe-fb92-4749-8ef6-b825581376a8', '60b17549-d298-4dfe-a54f-a61c4d6ac8f2', 'b860cf4f-f007-40a7-9732-dcaeb48217fc', 'f15aa0e7-20c8-41cc-a9da-af90fc09095a', '2b2274cf-1b64-4aa8-86d7-1976f121d239', 'e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d', '4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca', '7af381e4-0258-42b9-9d7f-b2370cc5a4ae', 'f33ed09a-fe24-4b0c-9bbd-6935d7eac81b', '0264584e-0080-46af-9c89-3cb2fcd0c26d', '1fca696a-0f49-455d-9cb9-9f974821973b', 'a3c78b55-33cd-47e8-95aa-4dc1be978038', '8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31', 'c1dcc0af-a718-4357-b117-90efbb3d6bec', '06e916b5-2321-4083-a362-4d91a75f9d62', '8b22e932-32d8-43d0-87bb-f6563236db76', '8b73d257-772b-49ed-a193-0adc505752e2', '8f5b8858-9649-4891-ac8f-4f6a330e3a51', '1a2ad9fb-edc6-4825-9f05-2a041fddcce1', '1520d4fa-edba-41bd-8755-7e34c635106e', '0282ecb1-21b7-414b-a78b-410dac72d851', '97be36bb-9aa7-4ca4-9b9b-f2f13467259b', '3e4f3999-c21c-4125-ba57-29d87cf22d79', 'bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6', '7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3', 'a1cc7026-1d45-4ec0-a32d-311a913b774a', '39207596-4602-4c59-b143-d5038ebffb91', 'd8f85b08-83ad-443d-9e32-5acb05ba6b8e', '981734c6-752d-40c2-ba2a-3f068cd82111', 'e55ab758-8173-4602-9e5f-c4388eb52159'} {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1060.591759] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1060.593346] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1060.594088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.616960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.617134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.617134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.617353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.617353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.617464] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1060.617532] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1060.617600] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1060.621556] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.622102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.622102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.622102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.622254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.623119] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf already deleted. [ 1060.623270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcf1d2e0-0126-40e3-afe0-bb56ba5d5ddf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.713238] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.713476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.713476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.713637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.714633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.719086] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1060.719086] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1060.719086] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1060.719086] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1060.719086] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1060.719086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGH for action security_group_rules [ 1060.719086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGH for action security_group_rules [ 1060.719086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGH for action security_group_rules [ 1060.719086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGH for action security_group_rules [ 1060.719086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGH for action security_group_rules [ 1060.719086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGH for action security_group_rules [ 1060.719410] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGH for action security_group_rules [ 1060.719410] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGH for action security_group_rules [ 1060.719410] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGH for action security_group_rules [ 1060.719410] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGH for action security_group_rules [ 1060.719410] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGH for action security_group_rules [ 1060.719410] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGH for action security_group_rules [ 1060.719566] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGH for action security_group_rules [ 1060.719566] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGH for action security_group_rules [ 1060.719566] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGH for action security_group_rules [ 1060.719641] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGH for action security_group_rules [ 1060.719824] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGH for action security_group_rules [ 1060.719824] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGH for action security_group_rules [ 1060.719824] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGH for action security_group_rules [ 1060.719961] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGH for action security_group_rules [ 1060.719961] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.772939] env[69255]: INFO networking_nsxv3.common.synchronization [None req-c267ad3f-9aca-465f-b248-b405f17e6cbb tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a228003c-531a-43cb-9396-964ab52c0831 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b860cf4f-f007-40a7-9732-dcaeb48217fc with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d24a10fe-fb92-4749-8ef6-b825581376a8 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f23576-868c-480d-b556-0aad9680f300 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 with Priority: HIGH for action security_group_rules [ 1060.775752] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf245b92-395b-436b-927d-80e3a468ef38 with Priority: HIGH for action security_group_rules [ 1060.776495] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fa580c-2432-422e-a13f-1995d2283ac0 with Priority: HIGH for action security_group_rules [ 1060.776495] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2623f063-14bb-4aff-bf17-71443391d8f7 with Priority: HIGH for action security_group_rules [ 1060.776495] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f8404c-0625-4de4-9522-49bae286c6f7 with Priority: HIGH for action security_group_rules [ 1060.776495] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a73172-9297-4dba-844d-93ad67b908a4 with Priority: HIGH for action security_group_rules [ 1060.776495] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGH for action security_group_rules [ 1060.777834] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.777834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.777964] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.778131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.778177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.778386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.778466] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48c2b23a-8e33-4b55-bd7f-88088c6e55c6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.779565] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d629ccb4-175d-4e83-941e-35fb3996c7a9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.779845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.779913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.780156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.780187] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d629ccb4-175d-4e83-941e-35fb3996c7a9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.783409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a228003c-531a-43cb-9396-964ab52c0831 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.783409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.783409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.783409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.783409] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a228003c-531a-43cb-9396-964ab52c0831',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.783409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b860cf4f-f007-40a7-9732-dcaeb48217fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.783835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.783835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.784153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.784153] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b860cf4f-f007-40a7-9732-dcaeb48217fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.788028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.788028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7af381e4-0258-42b9-9d7f-b2370cc5a4ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.788028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.788028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.788028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.788028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.788761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b2274cf-1b64-4aa8-86d7-1976f121d239 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.788877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.788939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.789143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.789215] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b2274cf-1b64-4aa8-86d7-1976f121d239',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.790399] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.790726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.790807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.790980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.791075] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b17549-d298-4dfe-a54f-a61c4d6ac8f2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.791804] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.792292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.792378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.792540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.792628] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.793373] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d24a10fe-fb92-4749-8ef6-b825581376a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.793472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.793534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.793697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.793767] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d24a10fe-fb92-4749-8ef6-b825581376a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.794607] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.794722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.794785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.794940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.795018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.795690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39f23576-868c-480d-b556-0aad9680f300 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.795789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.795873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.796463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.796569] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39f23576-868c-480d-b556-0aad9680f300',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.797348] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d36f190-eca4-498f-b2be-5b1977c816d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.797471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.797539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.797764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.797854] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d36f190-eca4-498f-b2be-5b1977c816d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.799082] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf245b92-395b-436b-927d-80e3a468ef38 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.799236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.799292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.799474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.799555] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf245b92-395b-436b-927d-80e3a468ef38',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.800356] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fa580c-2432-422e-a13f-1995d2283ac0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.800484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.800547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.800694] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.800782] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fa580c-2432-422e-a13f-1995d2283ac0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.801635] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2623f063-14bb-4aff-bf17-71443391d8f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.801785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.801851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.802023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.802091] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2623f063-14bb-4aff-bf17-71443391d8f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.803114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f8404c-0625-4de4-9522-49bae286c6f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.803291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.803291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.803432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.803512] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f8404c-0625-4de4-9522-49bae286c6f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.804779] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a73172-9297-4dba-844d-93ad67b908a4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.804924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.805187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.805266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.805327] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a73172-9297-4dba-844d-93ad67b908a4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.806464] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.806464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.806464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.806723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.806723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.888225] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.888225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.888225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.890870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.890870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.890870] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1060.923578] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.923578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.923578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.923578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.923578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.932316] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1061.085430] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.085787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.085787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.085974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.086092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.086244] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00293097-1dd1-4554-8c94-171a92644c52 already deleted. [ 1061.086304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.086459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.086624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.086710] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.225634] env[69255]: INFO networking_nsxv3.common.synchronization [req-1b9b820c-144d-4e8f-bdbb-f1ce88b16380 req-5c877b26-37a8-4b85-a6a1-66b0c739ecd6 tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: cf30f1c2-54b4-4989-8079-6c4b24fad86a with Priority: HIGHEST for action security_group_rules [ 1061.226541] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf30f1c2-54b4-4989-8079-6c4b24fad86a with Priority: HIGHEST for action security_group_rules [ 1061.227045] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf30f1c2-54b4-4989-8079-6c4b24fad86a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.227292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf30f1c2-54b4-4989-8079-6c4b24fad86a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.227371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf30f1c2-54b4-4989-8079-6c4b24fad86a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.227837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf30f1c2-54b4-4989-8079-6c4b24fad86a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.227837] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf30f1c2-54b4-4989-8079-6c4b24fad86a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.293920] env[69255]: INFO networking_nsxv3.common.synchronization [None req-1d9261c1-2088-4ac5-bfa4-8b653576b458 None None] Enqueued Resource ID: f1d7928b-8f29-48ce-bf4d-a4c62b7ec525 with Priority: HIGHEST for action port [ 1061.295542] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d7928b-8f29-48ce-bf4d-a4c62b7ec525 with Priority: HIGHEST for action port [ 1061.295899] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1d7928b-8f29-48ce-bf4d-a4c62b7ec525 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.295899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1d7928b-8f29-48ce-bf4d-a4c62b7ec525" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.296104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1d7928b-8f29-48ce-bf4d-a4c62b7ec525" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.296218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1d7928b-8f29-48ce-bf4d-a4c62b7ec525" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.296469] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1d7928b-8f29-48ce-bf4d-a4c62b7ec525',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.314078] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.314078] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.314078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.314078] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.328903] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.329245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.329378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.329624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.336906] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.337124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.337187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.337698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.337908] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.338072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.338168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.338387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.338510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.338626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.338736] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.345662] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.345805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.345843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.346031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.346288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.346414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.346483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.346641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.346728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.346816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.346927] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.375617] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9dbaa02f-7b0f-418f-9b2a-d5730a852eb6 None None] Enqueued Resource ID: 30d5c64d-f3b8-4b02-9bf8-cb4c405061ae with Priority: HIGHEST for action port [ 1061.389731] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d5c64d-f3b8-4b02-9bf8-cb4c405061ae with Priority: HIGHEST for action port [ 1061.392597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-30d5c64d-f3b8-4b02-9bf8-cb4c405061ae taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.392853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30d5c64d-f3b8-4b02-9bf8-cb4c405061ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.392853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30d5c64d-f3b8-4b02-9bf8-cb4c405061ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.393093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30d5c64d-f3b8-4b02-9bf8-cb4c405061ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.393192] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30d5c64d-f3b8-4b02-9bf8-cb4c405061ae',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.401374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.401538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.405665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.405779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.406720] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.406851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.412998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.413131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.414251] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.414364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.415656] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.415790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.417044] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.417145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.417903] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.417998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.418753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.418845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.419893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.420017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f8404c-0625-4de4-9522-49bae286c6f7 is going to be deleted. [ 1061.420946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.421252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.423745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.423862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.424627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.424717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.425337] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.425756] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.425877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.426498] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.430021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.430021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.430021] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.430021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.430021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.430021] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.430323] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.430323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.454383] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.454892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.455051] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39f23576-868c-480d-b556-0aad9680f300 is going to be deleted. [ 1061.456454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.456672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.480017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.480017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fa580c-2432-422e-a13f-1995d2283ac0 is going to be deleted. [ 1061.480017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.480017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.494326] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.494454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.509980] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.510157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.511099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.511215] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48c2b23a-8e33-4b55-bd7f-88088c6e55c6 is going to be deleted. [ 1061.512421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.514029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.554932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.555945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d629ccb4-175d-4e83-941e-35fb3996c7a9 is going to be deleted. [ 1061.557093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.558184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.614307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.614431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.621447] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.621609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.623166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.623303] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7af381e4-0258-42b9-9d7f-b2370cc5a4ae is going to be deleted. [ 1061.624255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.624505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.645388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.646170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.663838] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.663838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.687206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.687206] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b2274cf-1b64-4aa8-86d7-1976f121d239 is going to be deleted. [ 1061.687206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.687206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.736300] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.736455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.754399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.754888] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d24a10fe-fb92-4749-8ef6-b825581376a8 is going to be deleted. [ 1061.755893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.756462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.799658] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1d7928b-8f29-48ce-bf4d-a4c62b7ec525 [ 1061.800077] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.800295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.800429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.800736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.800883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.801066] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1d7928b-8f29-48ce-bf4d-a4c62b7ec525 already deleted. [ 1061.801200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1d7928b-8f29-48ce-bf4d-a4c62b7ec525" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.808963] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.809215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.817970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.818351] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b17549-d298-4dfe-a54f-a61c4d6ac8f2 is going to be deleted. [ 1061.819669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.820029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.832514] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.848682] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.853873] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.896057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.896242] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.896424] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30d5c64d-f3b8-4b02-9bf8-cb4c405061ae [ 1061.896587] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.896696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.896788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.897015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.897149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.897213] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30d5c64d-f3b8-4b02-9bf8-cb4c405061ae already deleted. [ 1061.897291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30d5c64d-f3b8-4b02-9bf8-cb4c405061ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.956950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.957083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.958420] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.958542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.966062] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.967026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.967026] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2623f063-14bb-4aff-bf17-71443391d8f7 is going to be deleted. [ 1061.968118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.968202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.026043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.026043] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d is going to be deleted. [ 1062.026043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.026043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.097400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.097400] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf245b92-395b-436b-927d-80e3a468ef38 is going to be deleted. [ 1062.097806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.098047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.159499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.161332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.167166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.167467] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a73172-9297-4dba-844d-93ad67b908a4 is going to be deleted. [ 1062.168829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.168938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.214749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.214749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.221870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.222631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a228003c-531a-43cb-9396-964ab52c0831 is going to be deleted. [ 1062.223876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.224732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.262391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.262612] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b860cf4f-f007-40a7-9732-dcaeb48217fc is going to be deleted. [ 1062.263666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.263944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.334728] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd8fc5f6-8c57-4558-8b42-ae2373cea267: rpc.has_security_group_logging(os_id): False [ 1062.353805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f15aa0e7-20c8-41cc-a9da-af90fc09095a: rpc.has_security_group_logging(os_id): False [ 1062.357435] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91d1981f-899d-44d8-9b18-06e5c0499d68: rpc.has_security_group_logging(os_id): False [ 1062.384035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.384140] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d36f190-eca4-498f-b2be-5b1977c816d8 is going to be deleted. [ 1062.385252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.385523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.385676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.385762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f8404c-0625-4de4-9522-49bae286c6f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.385949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.386746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.387262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.387262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39f23576-868c-480d-b556-0aad9680f300" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.387562] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48c2b23a-8e33-4b55-bd7f-88088c6e55c6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fa580c-2432-422e-a13f-1995d2283ac0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.388712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.388951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.388951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.388951] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00293097-1dd1-4554-8c94-171a92644c52 already deleted. [ 1062.389040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.389136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.389279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.389382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.389511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d629ccb4-175d-4e83-941e-35fb3996c7a9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.389635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.389785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.392519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.392697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7af381e4-0258-42b9-9d7f-b2370cc5a4ae" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.393320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.393584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.393706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.393823] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf30f1c2-54b4-4989-8079-6c4b24fad86a already deleted. [ 1062.393931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf30f1c2-54b4-4989-8079-6c4b24fad86a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.394270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.394354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.394406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.394516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d24a10fe-fb92-4749-8ef6-b825581376a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.394644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.394788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.394865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.394977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b2274cf-1b64-4aa8-86d7-1976f121d239" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.395117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.395259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.395326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.395443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b17549-d298-4dfe-a54f-a61c4d6ac8f2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.395556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.395690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.395764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.395865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9f19c84-3c45-4ce8-9bff-e5b8acf00d5d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.395998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.396159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.396260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.396375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2623f063-14bb-4aff-bf17-71443391d8f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.400348] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.400348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.400348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.400348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.402271] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.402271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.405965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.406134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.552030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.552284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.555269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.555404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.560075] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.562603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.562603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.562603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.562603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.562603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.562603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.563112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.563112] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a is going to be updated. [ 1062.564358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.564633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.585317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.585545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.609608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.610745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.610745] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.610879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.611607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.611607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.611607] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 is going to be updated. [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a228003c-531a-43cb-9396-964ab52c0831" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf245b92-395b-436b-927d-80e3a468ef38" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a73172-9297-4dba-844d-93ad67b908a4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.615191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.652960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.653333] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.653452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.653538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.653758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.653872] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.653999] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 is going to be updated. [ 1062.655864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.655864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.655864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.655864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b860cf4f-f007-40a7-9732-dcaeb48217fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.682773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.682971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.683088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.683322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.683443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.683616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d36f190-eca4-498f-b2be-5b1977c816d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.760096] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.760351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.760423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.760679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.760868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.801123] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.801421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.801567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.802013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.803333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.840021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: IN_PROGRESS for 2s [ 1062.842483] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: IN_PROGRESS for 2s [ 1062.866823] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.867066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.867159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.867351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.867508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.894463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: IN_PROGRESS for 2s [ 1062.952423] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1062.952737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.952795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.953056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.953278] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.954038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.954038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.954038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.954038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.954038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.954038] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.219518] env[69255]: INFO networking_nsxv3.common.synchronization [req-57ffc0ba-b1c9-4c15-96af-72a499f6176c req-c1355303-a118-4d21-96e8-40555f20b474 tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: d1da1360-5701-44d6-bec0-3195da828ca7 with Priority: HIGHEST for action security_group_rules [ 1063.221049] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1da1360-5701-44d6-bec0-3195da828ca7 with Priority: HIGHEST for action security_group_rules [ 1063.221845] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1da1360-5701-44d6-bec0-3195da828ca7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.222054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.222200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.223027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.223185] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1da1360-5701-44d6-bec0-3195da828ca7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.418990] env[69255]: INFO networking_nsxv3.common.synchronization [req-97a3f641-a0a7-45ab-9adb-231ab33d1a40 req-26c049a7-fa09-4b32-822b-4c5b95e44123 tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: d1da1360-5701-44d6-bec0-3195da828ca7 with Priority: HIGHEST for action security_group_rules [ 1063.420017] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1da1360-5701-44d6-bec0-3195da828ca7 with Priority: HIGHEST for action security_group_rules [ 1063.422229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1da1360-5701-44d6-bec0-3195da828ca7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.422229] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.466027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.466027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.466027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.466576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.466576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.466576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.466576] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.756269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.756403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.756403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.756577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.756662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.756756] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1da1360-5701-44d6-bec0-3195da828ca7 already deleted. [ 1063.756834] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.756980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.757153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.757241] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1da1360-5701-44d6-bec0-3195da828ca7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.810686] env[69255]: INFO networking_nsxv3.common.synchronization [req-0f672cde-f6ab-4fd1-9a46-981ce90f4431 req-8da240d0-3d5d-491b-8c9f-0bf162468608 tempest-SecurityGroupRulesTestJSON-1281154269 tempest-SecurityGroupRulesTestJSON-1281154269-project-member] Enqueued Resource ID: d1da1360-5701-44d6-bec0-3195da828ca7 with Priority: HIGHEST for action security_group_rules [ 1063.811553] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1da1360-5701-44d6-bec0-3195da828ca7 with Priority: HIGHEST for action security_group_rules [ 1063.811788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1da1360-5701-44d6-bec0-3195da828ca7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.811906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.822430] env[69255]: INFO networking_nsxv3.common.synchronization [None req-29c7f3e8-f219-474d-abb1-56771145b5f0 None None] Enqueued Resource ID: f0f6ad0a-f42f-488c-8ead-bc54ba8658f1 with Priority: HIGHEST for action port [ 1063.822665] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0f6ad0a-f42f-488c-8ead-bc54ba8658f1 with Priority: HIGHEST for action port [ 1063.823557] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0f6ad0a-f42f-488c-8ead-bc54ba8658f1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.825247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0f6ad0a-f42f-488c-8ead-bc54ba8658f1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.825247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0f6ad0a-f42f-488c-8ead-bc54ba8658f1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.825247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0f6ad0a-f42f-488c-8ead-bc54ba8658f1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.825247] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0f6ad0a-f42f-488c-8ead-bc54ba8658f1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.968941] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 1063.988096] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.988261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.988415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.988555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.008412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.009027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.009027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.009027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.009257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.009354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.009588] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.009698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.009763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.009925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.010485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.010485] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.010485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.010485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.010485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.010710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.010710] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1064.082275] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.082604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.082786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.083047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.083206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.100752] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1064.291259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.291594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.291594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.291703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.291789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.291886] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1da1360-5701-44d6-bec0-3195da828ca7 already deleted. [ 1064.291967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.292134] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.292328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.292418] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1da1360-5701-44d6-bec0-3195da828ca7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.327641] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0f6ad0a-f42f-488c-8ead-bc54ba8658f1 [ 1064.327641] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.327641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.327641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.327641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.327641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.327641] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0f6ad0a-f42f-488c-8ead-bc54ba8658f1 already deleted. [ 1064.327641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0f6ad0a-f42f-488c-8ead-bc54ba8658f1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.815860] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.816098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.816199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.816481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.816617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.816755] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1da1360-5701-44d6-bec0-3195da828ca7 already deleted. [ 1064.818459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1da1360-5701-44d6-bec0-3195da828ca7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.857439] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: SUCCESS [ 1064.857675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.858723] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: SUCCESS [ 1064.858983] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.908381] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: SUCCESS [ 1064.908565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113686] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1066.113943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.114149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.114362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.114449] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.616747] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.616907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.616978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.617225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.617399] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.617619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.617686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.617948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.617948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.618062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.618137] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.123352] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.123352] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.123352] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.123352] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.123352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.124074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.124074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.124074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.124074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.124074] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.626120] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca: rpc.has_security_group_logging(os_id): False [ 1067.652963] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.653146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.653211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.653425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.653519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.653751] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.653852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.653906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.654080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.654160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.654373] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.654514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.654607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.654760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.654835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.656826] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.656826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.656826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.657031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.657100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.657266] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1067.729244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.729388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.729453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.729664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.729813] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.748109] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1068.105346] env[69255]: INFO networking_nsxv3.common.synchronization [None req-4aebfe0a-0aab-4fa9-ac8b-e2f860754a4b None None] Enqueued Resource ID: bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc with Priority: HIGHEST for action port [ 1068.105656] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc with Priority: HIGHEST for action port [ 1068.106351] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.106558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.106558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.106800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.106883] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.611427] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc [ 1068.611701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.611774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.611848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.612083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.612178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.612275] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc already deleted. [ 1068.612354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bde3ecb8-0705-4a4d-b2f0-cec403b3d6fc" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.913792] env[69255]: INFO networking_nsxv3.common.synchronization [None req-b9aae32d-e6f6-4818-ae40-f81b680581da tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_rules [ 1068.914512] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_rules [ 1068.914868] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.915722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.915722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.915722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.915722] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.965892] env[69255]: INFO networking_nsxv3.common.synchronization [None req-db570c76-2cd0-42ca-bc7b-825121b83963 None None] Enqueued Resource ID: d7719a91-9a68-4d83-a047-ecb58128ec31 with Priority: HIGHEST for action port [ 1068.966294] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7719a91-9a68-4d83-a047-ecb58128ec31 with Priority: HIGHEST for action port [ 1068.969041] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7719a91-9a68-4d83-a047-ecb58128ec31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.969041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7719a91-9a68-4d83-a047-ecb58128ec31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.969041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7719a91-9a68-4d83-a047-ecb58128ec31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.969041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7719a91-9a68-4d83-a047-ecb58128ec31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.969041] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7719a91-9a68-4d83-a047-ecb58128ec31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.021217] env[69255]: INFO networking_nsxv3.common.synchronization [req-9c9b76fb-7b84-46fc-bb9d-6fadff2b91ff req-17804d25-56ba-489b-b95c-37a924071a30 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1069.022452] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1069.023055] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.024456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.024456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.027048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.027048] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.027048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.027048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.027048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.027048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.027048] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.049364] env[69255]: INFO networking_nsxv3.common.synchronization [None req-20cbb03c-87af-485b-82f8-0bc4656c9cec tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_rules [ 1069.049682] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_rules [ 1069.049982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.050098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.441065] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.441294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.441294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.441526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.441661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.441803] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 already deleted. [ 1069.441954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.442185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.442426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.442550] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.470680] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7719a91-9a68-4d83-a047-ecb58128ec31 [ 1069.470680] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.470680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.470680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.470680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.470680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.470680] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7719a91-9a68-4d83-a047-ecb58128ec31 already deleted. [ 1069.470680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7719a91-9a68-4d83-a047-ecb58128ec31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.528096] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.528294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.528365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.528576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.528670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.528860] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.529012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.529150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.529180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.529258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.529344] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 already deleted. [ 1069.529424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.767500] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.767835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.767835] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.768153] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.768428] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.768592] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.768712] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.768933] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.769205] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.769430] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.773024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.773024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.773024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.773024] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.773024] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.773024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.773024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1069.773024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.791626] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.791820] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.791956] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.792198] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.792529] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-f6221809-09d0-4d0c-9ebd-1744d32cfebe taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.792709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.792830] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.793204] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.793354] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6221809-09d0-4d0c-9ebd-1744d32cfebe',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.978789] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.979050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.979155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.979335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.979435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.979517] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 already deleted. [ 1069.979599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.148604] env[69255]: INFO networking_nsxv3.common.synchronization [req-da9eda01-c32b-41a2-ba33-8dfdae30b6e9 req-b0989a95-9b76-4452-b0ae-0dfdba943469 tempest-SecurityGroupRulesNegativeTestJSON-630599922 tempest-SecurityGroupRulesNegativeTestJSON-630599922-project-member] Enqueued Resource ID: 8ede1bdc-4564-4a0d-8e47-41ee0101f18e with Priority: HIGHEST for action security_group_rules [ 1070.149241] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ede1bdc-4564-4a0d-8e47-41ee0101f18e with Priority: HIGHEST for action security_group_rules [ 1070.149745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.149845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.149996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.150318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.150490] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ede1bdc-4564-4a0d-8e47-41ee0101f18e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.303690] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.303948] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.304098] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.304393] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.304540] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.304712] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port f6221809-09d0-4d0c-9ebd-1744d32cfebe not found, creating... [ 1070.304988] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.305187] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.305306] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.305532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.305718] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.306121] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.306466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.306466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.306613] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.308017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.308017] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: f6221809-09d0-4d0c-9ebd-1744d32cfebe is going to be created. [ 1070.329511] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.329729] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.329855] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.331761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.332051] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.332306] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.586621] env[69255]: INFO networking_nsxv3.common.synchronization [None req-69a217f0-550e-4e3c-89d8-2679d68304f8 None None] Enqueued Resource ID: 83748420-46d5-41d7-a21f-b5bb56c23dce with Priority: HIGHEST for action port [ 1070.586621] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83748420-46d5-41d7-a21f-b5bb56c23dce with Priority: HIGHEST for action port [ 1070.586621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-83748420-46d5-41d7-a21f-b5bb56c23dce taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.586919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83748420-46d5-41d7-a21f-b5bb56c23dce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.586919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83748420-46d5-41d7-a21f-b5bb56c23dce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.587478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83748420-46d5-41d7-a21f-b5bb56c23dce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.587583] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83748420-46d5-41d7-a21f-b5bb56c23dce',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.637368] env[69255]: INFO networking_nsxv3.common.synchronization [req-7be799c6-75e3-4ecc-8eb2-70bd6f71cc16 req-760d304c-2e45-49d2-a55b-f2fd6abf9c68 tempest-SecurityGroupRulesNegativeTestJSON-630599922 tempest-SecurityGroupRulesNegativeTestJSON-630599922-project-member] Enqueued Resource ID: 8ede1bdc-4564-4a0d-8e47-41ee0101f18e with Priority: HIGHEST for action security_group_rules [ 1070.639923] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ede1bdc-4564-4a0d-8e47-41ee0101f18e with Priority: HIGHEST for action security_group_rules [ 1070.640648] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.640648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.679158] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.679299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.679385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.679612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.679701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.679853] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ede1bdc-4564-4a0d-8e47-41ee0101f18e already deleted. [ 1070.679947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.680121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.680394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.680569] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ede1bdc-4564-4a0d-8e47-41ee0101f18e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.072955] env[69255]: INFO networking_nsxv3.common.synchronization [req-9c9b76fb-7b84-46fc-bb9d-6fadff2b91ff req-8e263806-ff21-4bc7-88ac-71af9d8a1aa2 service nova] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1071.073273] env[69255]: INFO networking_nsxv3.common.synchronization [req-9c9b76fb-7b84-46fc-bb9d-6fadff2b91ff req-8e263806-ff21-4bc7-88ac-71af9d8a1aa2 service nova] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1071.073341] env[69255]: INFO networking_nsxv3.common.synchronization [req-9c9b76fb-7b84-46fc-bb9d-6fadff2b91ff req-8e263806-ff21-4bc7-88ac-71af9d8a1aa2 service nova] Enqueued Resource ID: f6221809-09d0-4d0c-9ebd-1744d32cfebe with Priority: HIGHEST for action port [ 1071.073567] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1071.073636] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1071.073745] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6221809-09d0-4d0c-9ebd-1744d32cfebe with Priority: HIGHEST for action port [ 1071.075370] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.075370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.075370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.075370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.075370] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.077163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.077163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.077163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.077163] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.078835] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6221809-09d0-4d0c-9ebd-1744d32cfebe taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.078835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.078835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.078835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.078835] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6221809-09d0-4d0c-9ebd-1744d32cfebe',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.090790] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83748420-46d5-41d7-a21f-b5bb56c23dce [ 1071.090790] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.090790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.090790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.090790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.090790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.091078] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83748420-46d5-41d7-a21f-b5bb56c23dce already deleted. [ 1071.091078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83748420-46d5-41d7-a21f-b5bb56c23dce" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.201895] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.202128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.202128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.202345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.202481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.202528] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ede1bdc-4564-4a0d-8e47-41ee0101f18e already deleted. [ 1071.202629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ede1bdc-4564-4a0d-8e47-41ee0101f18e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.267351] env[69255]: INFO networking_nsxv3.common.synchronization [None req-91631854-fcc8-40a4-86e0-d9cb51df611e None None] Enqueued Resource ID: f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1 with Priority: HIGHEST for action port [ 1071.267351] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1 with Priority: HIGHEST for action port [ 1071.267707] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.267780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.267994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.268352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.268462] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.461413] env[69255]: INFO networking_nsxv3.common.synchronization [req-6b76e5f0-fe05-42ed-97b3-5854a71566e6 req-c14ac89d-0a0e-4dfa-992e-b8745a900892 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1071.461545] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1071.463678] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.463678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.463678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.463678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.463956] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.464064] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.464095] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.464375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.464499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.464713] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.582299] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.583839] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.583974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.584161] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6221809-09d0-4d0c-9ebd-1744d32cfebe with status ACTIVE [ 1071.584333] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.584443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.584509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.584712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.584803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.584976] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.588322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.588405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.588622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.588715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.588953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.589172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.589172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.593023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.593023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.593023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6221809-09d0-4d0c-9ebd-1744d32cfebe is going to be updated. [ 1071.613858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.613858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.613858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.613858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.613858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.613858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6221809-09d0-4d0c-9ebd-1744d32cfebe" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.771087] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1 [ 1071.771433] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.771537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.771572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.771821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.771899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.772101] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1 already deleted. [ 1071.772144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1f848c7-1641-43f7-b9ac-ef3a8f94d5a1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.967661] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.967968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.967968] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.968154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.968250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.968459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.968562] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.968625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.968778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.968853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.968956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 already deleted. [ 1071.969170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.093419] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.132018] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.132018] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.132018] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.132556] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.132556] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.132556] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.132556] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.132707] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.132707] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.133294] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.157502] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.157698] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.157844] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.158162] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.158513] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-38e9d518-2942-4eb6-884f-5e8257a484ef taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.158693] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.158818] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.159233] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.159378] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e9d518-2942-4eb6-884f-5e8257a484ef',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.595920] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.596217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.596333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.596673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.596824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.597019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be created. [ 1072.623579] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.623806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.623919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.624240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.624495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.636857] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: UNINITIALIZED for 2s [ 1072.662332] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.662505] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.663209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.663209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.663209] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.663375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 38e9d518-2942-4eb6-884f-5e8257a484ef not found, creating... [ 1072.663487] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.663648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.663778] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.663995] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.664177] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.664553] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.664829] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.664829] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.665162] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.665344] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.665498] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 38e9d518-2942-4eb6-884f-5e8257a484ef is going to be created. [ 1072.685014] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.685266] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.685441] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.685700] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.686145] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.686225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.381188] env[69255]: INFO networking_nsxv3.common.synchronization [req-6b76e5f0-fe05-42ed-97b3-5854a71566e6 req-f3bd8565-312a-4082-8c4c-5378d37eff42 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1073.383975] env[69255]: INFO networking_nsxv3.common.synchronization [req-6b76e5f0-fe05-42ed-97b3-5854a71566e6 req-f3bd8565-312a-4082-8c4c-5378d37eff42 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1073.383975] env[69255]: INFO networking_nsxv3.common.synchronization [req-6b76e5f0-fe05-42ed-97b3-5854a71566e6 req-f3bd8565-312a-4082-8c4c-5378d37eff42 service nova] Enqueued Resource ID: 38e9d518-2942-4eb6-884f-5e8257a484ef with Priority: HIGHEST for action port [ 1073.383975] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1073.383975] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1073.383975] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e9d518-2942-4eb6-884f-5e8257a484ef with Priority: HIGHEST for action port [ 1073.384146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.384271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.384358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.384781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.384896] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.385857] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.386009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.386058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.386246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.386395] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.386490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.386552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.386697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.386782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.386870] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.388577] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e9d518-2942-4eb6-884f-5e8257a484ef taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.388577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.388577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.388577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.388787] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e9d518-2942-4eb6-884f-5e8257a484ef',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.894974] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.894974] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.894974] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e9d518-2942-4eb6-884f-5e8257a484ef with status ACTIVE [ 1073.894974] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.894974] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.894974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.895726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.895726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.895726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.895726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.895726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.895726] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e9d518-2942-4eb6-884f-5e8257a484ef is going to be updated. [ 1073.920109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.920269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.920340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.920547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.920689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.920858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e9d518-2942-4eb6-884f-5e8257a484ef" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.398440] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.648037] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1074.648385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.648643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.648985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.649291] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.649488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.649601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.649870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.650315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.650537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.650747] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.902145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.902342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.902384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.902605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.902685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.902841] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be created. [ 1074.967474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.967734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.968370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.968370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.968370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.004114] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: UNINITIALIZED for 2s [ 1075.153295] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.656177] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00293097-1dd1-4554-8c94-171a92644c52: rpc.has_security_group_logging(os_id): False [ 1075.675506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.675781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.675864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.676204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.676487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.676728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.676885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.676995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.677267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.677410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.677558] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be created. [ 1075.742273] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.742495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.742495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.742691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.742875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.754422] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1076.888410] env[69255]: INFO networking_nsxv3.common.synchronization [req-6d04e8e3-b606-4c7b-9d5b-bb80eec53282 req-afa4c2ee-66a9-4a31-867e-a11cbc5935e3 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1076.889021] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1076.889380] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.889612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.889705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.890113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.890302] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.890472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.890575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.890946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.890946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.890946] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.016251] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1077.016487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.016849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.016918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.017101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.017220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.017286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.017440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.017523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.017610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.017740] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.173571] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.173766] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.173923] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.174238] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.174498] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.174657] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.174785] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.175023] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.175155] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.175367] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.175479] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.175589] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.175695] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.175803] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.175912] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.176060] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.195909] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.196095] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.196236] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.196414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.196733] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-23b6021e-2986-4661-98c4-bda2e8b708e1 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.196901] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.197034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.197383] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.197518] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b6021e-2986-4661-98c4-bda2e8b708e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.393919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.394174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.394265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.394621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.394726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.395028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.395220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.395453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.395540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.395619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.395733] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b already deleted. [ 1077.395851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.521945] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.521945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.521945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.522238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.522361] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.522438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.522499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.522648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.522774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.522847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.522967] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.523075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.523133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.523292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.523430] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.523514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.523575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.523715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.523793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.523873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.523969] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.699932] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.700226] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.700364] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.700673] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.700839] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.701022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 23b6021e-2986-4661-98c4-bda2e8b708e1 not found, creating... [ 1077.701321] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.701504] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.701632] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.701886] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.702056] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.702373] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.702548] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.702677] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.702908] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.703066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.703221] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 23b6021e-2986-4661-98c4-bda2e8b708e1 is going to be created. [ 1077.729555] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.729555] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.729850] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.729906] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.730522] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.730522] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.767920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1077.768211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.026172] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1078.047272] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.047454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.047490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.048149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.048149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.048149] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.048149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.048440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.048537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.048628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.048878] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.048998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.049074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.049792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.050849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.051140] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.052058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.052058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.052058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.052058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.052058] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be created. [ 1078.123530] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.123764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.123764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.123952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.124270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.138522] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1078.508335] env[69255]: INFO networking_nsxv3.common.synchronization [req-75007a6b-5e5f-4c30-bcf1-03c1d0ecc5b9 req-30d7f271-d648-490a-82f9-8627542f859a tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_members [ 1078.508335] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_members [ 1078.508335] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.508335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.508710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.509203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.509496] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.509729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.510205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.510529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.510716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.510903] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.632062] env[69255]: INFO networking_nsxv3.common.synchronization [req-6d04e8e3-b606-4c7b-9d5b-bb80eec53282 req-5497cf6f-05cc-4f94-824a-0485f43899f0 service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1078.632062] env[69255]: INFO networking_nsxv3.common.synchronization [req-6d04e8e3-b606-4c7b-9d5b-bb80eec53282 req-5497cf6f-05cc-4f94-824a-0485f43899f0 service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1078.632062] env[69255]: INFO networking_nsxv3.common.synchronization [req-6d04e8e3-b606-4c7b-9d5b-bb80eec53282 req-5497cf6f-05cc-4f94-824a-0485f43899f0 service nova] Enqueued Resource ID: 23b6021e-2986-4661-98c4-bda2e8b708e1 with Priority: HIGHEST for action port [ 1078.632062] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1078.632062] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1078.632817] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b6021e-2986-4661-98c4-bda2e8b708e1 with Priority: HIGHEST for action port [ 1078.633325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.633642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.633809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.634217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.634399] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.635423] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.635709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.635907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.636199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.636445] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.636650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.636797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.637047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.637222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.637395] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.638354] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b6021e-2986-4661-98c4-bda2e8b708e1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.638628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.638781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.639041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.639217] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b6021e-2986-4661-98c4-bda2e8b708e1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.888058] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.888058] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.888058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.888058] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.888058] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.888058] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.888058] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.888811] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.888811] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.889806] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.925022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.925022] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.925022] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.925022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.925022] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-d434ad4e-1349-481f-badf-b73d19f17fd5 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.925022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.925022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.925022] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.925022] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d434ad4e-1349-481f-badf-b73d19f17fd5',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.013738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.014205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.014205] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.014499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.014692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.015033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.015215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.015341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.015637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.015742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.015917] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 already deleted. [ 1079.016085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.144308] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.144970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.145454] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.146798] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b6021e-2986-4661-98c4-bda2e8b708e1 with status ACTIVE [ 1079.147280] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.147626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.147826] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.148224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.148464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.148873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.149175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.149408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.152023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.152023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.152023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.152023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.152023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.152023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.152023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.152023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b6021e-2986-4661-98c4-bda2e8b708e1 is going to be updated. [ 1079.180679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.181178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.181372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.181712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.181958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.182275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b6021e-2986-4661-98c4-bda2e8b708e1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.428468] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.428823] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.429059] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.429508] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.429757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.429987] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port d434ad4e-1349-481f-badf-b73d19f17fd5 not found, creating... [ 1079.430408] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.430646] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.430852] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.431181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.431343] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.431710] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.432586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.432814] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.433144] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.433321] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.433479] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: d434ad4e-1349-481f-badf-b73d19f17fd5 is going to be created. [ 1079.461133] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.461133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.461133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.461133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.461133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.461133] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.656408] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.153689] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1080.154224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.160175] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.160175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.160175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.160579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.160616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.160732] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be created. [ 1080.194262] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.194460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.194498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.194867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.195279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.209620] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: UNINITIALIZED for 2s [ 1080.251329] env[69255]: INFO networking_nsxv3.common.synchronization [req-75007a6b-5e5f-4c30-bcf1-03c1d0ecc5b9 req-28c0439f-35a1-42d4-8250-4b04c1d5185b service nova] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_rules [ 1080.251581] env[69255]: INFO networking_nsxv3.common.synchronization [req-75007a6b-5e5f-4c30-bcf1-03c1d0ecc5b9 req-28c0439f-35a1-42d4-8250-4b04c1d5185b service nova] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_members [ 1080.251762] env[69255]: INFO networking_nsxv3.common.synchronization [req-75007a6b-5e5f-4c30-bcf1-03c1d0ecc5b9 req-28c0439f-35a1-42d4-8250-4b04c1d5185b service nova] Enqueued Resource ID: d434ad4e-1349-481f-badf-b73d19f17fd5 with Priority: HIGHEST for action port [ 1080.254869] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_rules [ 1080.254960] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_members [ 1080.255077] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d434ad4e-1349-481f-badf-b73d19f17fd5 with Priority: HIGHEST for action port [ 1080.258206] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.258330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.258507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.258800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.259937] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.260737] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.261477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.261514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.261737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.261931] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.262048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.262112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.262392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.262424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.262537] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.264184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d434ad4e-1349-481f-badf-b73d19f17fd5 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.264331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.264374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.265443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.265443] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d434ad4e-1349-481f-badf-b73d19f17fd5',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.761282] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.761544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.767433] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.768796] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d434ad4e-1349-481f-badf-b73d19f17fd5 with status ACTIVE [ 1080.769029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.769248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.769340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.769535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.769635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.770021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.770021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.770021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.770307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.770307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.770511] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.770679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.770725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.770878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.770960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.771075] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d434ad4e-1349-481f-badf-b73d19f17fd5 is going to be updated. [ 1080.794888] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.795115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.795317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.795664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.795889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.796202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d434ad4e-1349-481f-badf-b73d19f17fd5" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.274047] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.778062] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.778316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.778316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.778513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.778607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.778729] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 is going to be created. [ 1081.807125] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.808082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.808082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.808082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.808082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.821463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 in Status: UNINITIALIZED for 2s [ 1082.223709] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1082.224170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.224520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.224879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.225211] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.225473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.225689] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.225984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.226124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.226222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.226318] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.729606] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.729981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.729981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.730076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.730248] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.730346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.730391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.730539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.730628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.730713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.730855] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.730945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.731017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.731159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.731293] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.731383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.731442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.731576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.731654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.731732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.731821] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.236965] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b: rpc.has_security_group_logging(os_id): False [ 1083.259597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.259779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.259869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.260103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.260243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.260380] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.260477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.260536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.260687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.260764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.260947] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.261057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.261139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.261298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.261373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.261570] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.261675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.261757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.261916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.261975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.262137] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be created. [ 1083.343610] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.343810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.343888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.345060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.345060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.364263] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1083.834172] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 in Status: SUCCESS [ 1083.834691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.834916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.835637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.835637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.835637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.836249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.836249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.836249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.836249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.836398] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.339719] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.842931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fd39125-1025-4df0-b3ea-a2af3c55cee9: rpc.has_security_group_logging(os_id): False [ 1084.865205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.865435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.865526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.865744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.865982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.866154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.866281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.866464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.866661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.866754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.866952] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 is going to be created. [ 1084.951960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.952202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.952202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.952413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.952591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.970469] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 in Status: IN_PROGRESS for 2s [ 1085.256132] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1085.256132] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1085.378179] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1085.378312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.982083] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 in Status: SUCCESS [ 1086.982447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.751292] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6d18a2a-6adc-428f-b63e-b8cb98e9df26 req-dc4a7d24-2b35-470c-8386-a7ea61253b8a tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1088.752246] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1088.752923] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.753176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.753317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.753704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.753984] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.754196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.754319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.754679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.754796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.754983] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.258498] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.375280] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.375532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.375751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.376113] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.376498] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.377181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.377181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.377181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.377414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.377652] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.377810] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.377947] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.378117] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.378284] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.378423] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.378654] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.400096] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.400318] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.400444] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.400634] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.401056] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-46d4eaff-3d18-4002-939e-ee7e425e39ec taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.401249] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.401381] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.402035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.402035] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46d4eaff-3d18-4002-939e-ee7e425e39ec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.762030] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.904662] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.904876] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.904985] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.905409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.905601] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.905802] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 46d4eaff-3d18-4002-939e-ee7e425e39ec not found, creating... [ 1089.906506] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.906751] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.906914] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.907206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.907414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.907732] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.907928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.908110] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.908312] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.908711] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.908711] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 46d4eaff-3d18-4002-939e-ee7e425e39ec is going to be created. [ 1089.932136] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.932390] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.932521] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.932830] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.933083] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.933319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.266639] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.266810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.266848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.267077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.267175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.267330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1090.321698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.321948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.327546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.327546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.327546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.345476] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1090.647160] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6d18a2a-6adc-428f-b63e-b8cb98e9df26 req-b6877a11-b11e-479a-8950-93525c073b36 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1090.647160] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6d18a2a-6adc-428f-b63e-b8cb98e9df26 req-b6877a11-b11e-479a-8950-93525c073b36 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1090.647160] env[69255]: INFO networking_nsxv3.common.synchronization [req-d6d18a2a-6adc-428f-b63e-b8cb98e9df26 req-b6877a11-b11e-479a-8950-93525c073b36 service nova] Enqueued Resource ID: 46d4eaff-3d18-4002-939e-ee7e425e39ec with Priority: HIGHEST for action port [ 1090.647160] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1090.647160] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1090.647160] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46d4eaff-3d18-4002-939e-ee7e425e39ec with Priority: HIGHEST for action port [ 1090.649626] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.649626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.649626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.649626] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.649626] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.649891] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.649934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.650145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-46d4eaff-3d18-4002-939e-ee7e425e39ec taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.650246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.650307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.650467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.650540] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46d4eaff-3d18-4002-939e-ee7e425e39ec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.718450] env[69255]: INFO networking_nsxv3.common.synchronization [req-3ad16aa2-6da7-40b6-8acf-2bcd37f9af0b req-0cec48fa-1dd5-4919-9d03-8199fa5ed13c tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1090.719043] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1090.719375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.719506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.719582] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.719808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.719961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.720074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.720133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.720283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.720367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.720461] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.153992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.154286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.154356] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46d4eaff-3d18-4002-939e-ee7e425e39ec with status ACTIVE [ 1091.154522] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.154622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.154678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.154887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.154978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.155167] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.155290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.155377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.155613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.155696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.155924] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.156047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.156112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.156258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.156334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.156421] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46d4eaff-3d18-4002-939e-ee7e425e39ec is going to be updated. [ 1091.175834] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.176069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.176069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.176253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.176395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.176612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46d4eaff-3d18-4002-939e-ee7e425e39ec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.225609] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.225858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.225944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.226140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.254570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.254823] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.254985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.255093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.255280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.255387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.255462] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1091.313483] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.313781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.314178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.314257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.314497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.331350] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1091.719360] env[69255]: INFO networking_nsxv3.common.synchronization [req-b1ec4066-f73f-42a6-87cf-e96afbc5263d req-0e233c38-bc31-471c-8ae8-7c391cecc198 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1091.720449] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1091.720449] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.720650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.720650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.720838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.721430] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.721430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.721430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.721430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.721758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.721758] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.224506] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.224782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.224782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.225035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.225120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.225300] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.225395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.225427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.225578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.225659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.225748] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1092.330036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.330218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.330218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.330830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.330830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.341376] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1092.356231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1092.356549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.356793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.357108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.357404] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.357578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.357683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.357927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.358376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.358565] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.861791] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.346163] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1093.346563] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b deletion is rescheduled due to dependency. [ 1093.346563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.364078] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.868807] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.868807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.868807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.868807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.868807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.868807] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1093.918583] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.918583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.918583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.918583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.918583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.926695] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1094.166548] env[69255]: INFO networking_nsxv3.common.synchronization [req-09b9e5c3-4f67-4aac-871c-0b8cc4c00184 req-e12d9efc-1999-4cd7-974c-85432feeabd6 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1094.167416] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1094.167880] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.168027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.168102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.168560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.168560] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.168560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.168761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.168761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.168850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.168962] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.352285] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1094.352638] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b deletion is rescheduled due to dependency. [ 1094.352638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.671268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.671425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.671495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.671718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.695217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.695217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.695411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.695467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.695835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.696047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.696441] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1094.730282] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.730282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.730282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.730282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.730282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.740413] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1094.999910] env[69255]: INFO networking_nsxv3.common.synchronization [req-84eb82d7-5824-43b0-8a7e-0d86d12f6648 req-3230dafc-ff4a-446d-a08c-fd9572d009c8 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_members [ 1095.000375] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGHEST for action security_group_members [ 1095.000683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.000802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.000867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.001087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.001497] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.001497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.001497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.001652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.001652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.001781] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.506622] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.506622] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.506622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.506622] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 is going to be updated. [ 1095.540499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.540499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.540499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.540499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.540499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.549393] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: IN_PROGRESS for 2s [ 1095.561165] env[69255]: INFO networking_nsxv3.common.synchronization [req-b54fcd82-32ec-495c-9cc6-923c1c40ea44 req-2b79b548-36af-4e64-b8ab-84d5643149ba tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_members [ 1095.561165] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGHEST for action security_group_members [ 1095.561756] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.562187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.562425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.563267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.563629] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.563946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.566027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.566027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.566027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.566027] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.937522] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1095.937809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.938011] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.938264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.938466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.938829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.938829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.938829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.938965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.939046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.939271] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.067873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.068051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.068097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.072023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.072023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.072023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.072023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.072023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.072023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.072023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.072023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a is going to be updated. [ 1096.102792] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.103040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.103173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.103394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.103555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.113375] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: IN_PROGRESS for 2s [ 1096.442574] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.443080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.443339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.443677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.443983] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.444270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.444416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.444749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.444915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446098] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.446098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.446098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.446098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.446435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.446435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.446435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.446609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.446877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.447026] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.774374] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1096.774777] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 1096.774777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.864906] env[69255]: INFO networking_nsxv3.common.synchronization [req-3bef30e6-8ec9-4283-b5c5-d991aaae996b req-85bbf28f-9da2-4d03-8d49-af8f38548a6f tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1096.865105] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1096.865441] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.865585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.865677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.865903] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.866283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.866387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.866550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.867028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.867028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.867028] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.949452] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1096.972021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.972021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.972021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.972021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.972610] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.972610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.972610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.972610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.972610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.972761] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1097.044943] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.045179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.045258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.046154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.046338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.061956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1097.185030] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.185030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.185030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.185030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.185586] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.186027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.186378] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.186828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.187259] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.187720] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.188065] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.189027] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.189027] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.189027] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.189216] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.189295] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.208795] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.209134] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.209292] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.209562] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-913" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.210011] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-30263cef-fbf6-43a9-9356-1caff03faf62 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.210319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.210503] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.210958] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.211189] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30263cef-fbf6-43a9-9356-1caff03faf62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.368969] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.369143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.369218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.369462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.369556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.369755] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.369876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.369955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.370218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.370302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.370397] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1097.398372] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.398583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.398624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.398829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.398965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.409250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1097.559250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 in Status: SUCCESS [ 1097.559455] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 deletion is rescheduled due to dependency. [ 1097.559595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.714526] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.714717] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.715141] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.715141] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.715303] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.715460] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 30263cef-fbf6-43a9-9356-1caff03faf62 not found, creating... [ 1097.716053] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.716053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.716053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.716254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.716510] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.716839] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.717090] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.717620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.717620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.717620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.717862] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 30263cef-fbf6-43a9-9356-1caff03faf62 is going to be created. [ 1097.742667] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.742883] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.743035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.743391] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.743635] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.743926] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.124991] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a in Status: SUCCESS [ 1098.125350] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a deletion is rescheduled due to dependency. [ 1098.125396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.444626] env[69255]: INFO networking_nsxv3.common.synchronization [req-3bef30e6-8ec9-4283-b5c5-d991aaae996b req-93b5d239-00e5-4951-920c-9c5e6864355b service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 1098.444930] env[69255]: INFO networking_nsxv3.common.synchronization [req-3bef30e6-8ec9-4283-b5c5-d991aaae996b req-93b5d239-00e5-4951-920c-9c5e6864355b service nova] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1098.445221] env[69255]: INFO networking_nsxv3.common.synchronization [req-3bef30e6-8ec9-4283-b5c5-d991aaae996b req-93b5d239-00e5-4951-920c-9c5e6864355b service nova] Enqueued Resource ID: 30263cef-fbf6-43a9-9356-1caff03faf62 with Priority: HIGHEST for action port [ 1098.446464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_rules [ 1098.446464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1098.446464] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30263cef-fbf6-43a9-9356-1caff03faf62 with Priority: HIGHEST for action port [ 1098.446464] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.446800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.446800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.447068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.447068] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.450320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.450320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.450320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-30263cef-fbf6-43a9-9356-1caff03faf62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.450320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.450320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.450320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.450320] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30263cef-fbf6-43a9-9356-1caff03faf62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.949884] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.950135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.951480] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30263cef-fbf6-43a9-9356-1caff03faf62 with status ACTIVE [ 1098.951698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.951895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.951895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.952153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.952250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.952436] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.952537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.952601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.952760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.952839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.953032] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.953130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.953193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.953338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.953414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.953500] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30263cef-fbf6-43a9-9356-1caff03faf62 is going to be updated. [ 1099.007219] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.007425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.007425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.007639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.007776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.007940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30263cef-fbf6-43a9-9356-1caff03faf62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.078558] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1099.078777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.419918] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1099.420456] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 1099.420456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.420456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.420727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.420727] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.420863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.420898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.421099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.421216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.421317] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.924290] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.427041] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.931045] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.931045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.931045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.931045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.931045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.931350] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1100.965041] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.965041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.965041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.965041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.965041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.973977] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1102.010131] env[69255]: INFO networking_nsxv3.common.synchronization [req-64de868d-0940-476e-98fd-45bc1a0e950f req-a60414b2-0a89-4cdf-afe3-88f437cf0c29 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1102.010657] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1102.010961] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.011101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.011170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.011372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.011911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.012055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.012131] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.012312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.012401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.012495] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.425634] env[69255]: INFO networking_nsxv3.common.synchronization [req-b9811f47-5a7b-4eb5-bf9b-fe8dfab5add1 req-856c3977-64c1-462f-bcec-3e21d3d13aa5 tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1102.426194] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1102.426520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.426647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.426716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.427024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.427248] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.427367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.427436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.427610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.427700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.427797] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.514989] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.710846] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.711624] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.711624] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.711624] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.711829] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.711895] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.711992] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.712224] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.712375] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.712590] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.712713] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.712829] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.712943] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.713073] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.713186] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.713327] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.735998] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.736206] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.736353] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.736540] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.736869] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-d3a12395-6f4e-4a7c-8edc-a90696f24457 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.737144] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.737320] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.737665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.737815] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3a12395-6f4e-4a7c-8edc-a90696f24457',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.930647] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.930647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.930647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.930800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.930800] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.931023] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.931130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.931196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.931362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.931441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.931528] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1102.957461] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.957683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.957683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.957920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.958054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.967210] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1102.982829] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1102.983008] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.983183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.983403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.983608] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.983725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.983801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.983962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.984109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.984154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.984228] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.017595] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.240090] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.240349] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.240409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.240718] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.240872] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.241052] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port d3a12395-6f4e-4a7c-8edc-a90696f24457 not found, creating... [ 1103.241322] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.241488] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.241613] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.241834] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.241979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.242305] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.242475] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.242608] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.242828] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.242976] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.243151] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: d3a12395-6f4e-4a7c-8edc-a90696f24457 is going to be created. [ 1103.264549] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.264760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.264928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.265276] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.265538] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.265777] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.486081] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.486261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.486335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.486737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.486737] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.486892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.487199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.487199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.487199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.487395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.487431] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.487526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.487566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.487701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.487838] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.487928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.487999] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.488164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.488243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.488328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.488431] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.520288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.520483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.520529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.521515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.521515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.521515] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1103.562114] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.562311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.562372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.562564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.562711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.571645] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1103.602995] env[69255]: INFO networking_nsxv3.common.synchronization [req-c153facc-2de7-472c-bb85-92d2f2a7ff54 req-c39c2812-dd0e-47c2-a958-da03a66eaa8a tempest-DeleteServersTestJSON-38546146 tempest-DeleteServersTestJSON-38546146-project-member] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1103.603649] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGHEST for action security_group_members [ 1103.604520] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.604678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.604753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.604975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.605164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.605273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.605347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.605549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.605672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.605788] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.992564] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 981734c6-752d-40c2-ba2a-3f068cd82111: rpc.has_security_group_logging(os_id): False [ 1104.018146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.018460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.018460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.018599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.018663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.018852] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.018950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.019024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.019277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.019277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.019441] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.019528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.019791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.019791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.019791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.019998] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.022788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.022866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.023050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.023137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.023233] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1104.082706] env[69255]: INFO networking_nsxv3.common.synchronization [req-b9811f47-5a7b-4eb5-bf9b-fe8dfab5add1 req-edc9e1e1-424e-4e87-8736-7c2647a0c922 service nova] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 1104.082911] env[69255]: INFO networking_nsxv3.common.synchronization [req-b9811f47-5a7b-4eb5-bf9b-fe8dfab5add1 req-edc9e1e1-424e-4e87-8736-7c2647a0c922 service nova] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1104.083095] env[69255]: INFO networking_nsxv3.common.synchronization [req-b9811f47-5a7b-4eb5-bf9b-fe8dfab5add1 req-edc9e1e1-424e-4e87-8736-7c2647a0c922 service nova] Enqueued Resource ID: d3a12395-6f4e-4a7c-8edc-a90696f24457 with Priority: HIGHEST for action port [ 1104.083343] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 1104.083474] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1104.083572] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a12395-6f4e-4a7c-8edc-a90696f24457 with Priority: HIGHEST for action port [ 1104.084230] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.084370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.084449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.084635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.084715] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.085663] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.085761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.085957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3a12395-6f4e-4a7c-8edc-a90696f24457 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.086223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.086223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.086297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.086372] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3a12395-6f4e-4a7c-8edc-a90696f24457',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.107937] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.108135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.108249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.108549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.108692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.108990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.109166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.109243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.109531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.109625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.109716] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be updated. [ 1104.130627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.130768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.130871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.131165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.131448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.150389] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1104.154188] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.154350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.154388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.154604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.154802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.168608] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: IN_PROGRESS for 2s [ 1104.590072] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3a12395-6f4e-4a7c-8edc-a90696f24457 with status ACTIVE [ 1104.590072] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.590308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.590434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.590698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.590858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.591195] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.591374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.591508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.591778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.591941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.592291] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.592463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.592617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.592811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.592951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.593139] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3a12395-6f4e-4a7c-8edc-a90696f24457 is going to be updated. [ 1104.595325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.595494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.617580] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.617848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.617848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.617998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.618154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.618328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3a12395-6f4e-4a7c-8edc-a90696f24457" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.977744] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1104.977744] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b deletion is rescheduled due to dependency. [ 1104.977744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.977744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.978141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.978320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.978486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.978574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.978768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.978932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.979072] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.481503] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.583517] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1105.583784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.984423] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.167288] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1106.167846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.177942] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca in Status: SUCCESS [ 1106.177942] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca deletion is rescheduled due to dependency. [ 1106.177942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.486323] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.486323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.486323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.486664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.486664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.486728] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1106.524799] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.524799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.524799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.524799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.524799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.533447] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1106.687122] env[69255]: INFO networking_nsxv3.common.synchronization [None req-a52629fa-e39c-401e-85dd-5b76c0e7c2ea tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_rules [ 1106.687977] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_rules [ 1106.689055] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.689055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.689055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.689055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.689300] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.767583] env[69255]: INFO networking_nsxv3.common.synchronization [None req-ba683f0d-bead-433a-bef1-8608c45b1c66 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_rules [ 1106.768190] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_rules [ 1106.768521] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.768624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.208754] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.208899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.208962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.209555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.209555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.209555] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 already deleted. [ 1107.209555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.209555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.209773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.209805] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.735984] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.735984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.735984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.735984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.735984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.735984] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 already deleted. [ 1107.735984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.564975] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1108.565228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.565403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.565658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.565864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.565978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.566073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.566243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.566367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.566405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.566491] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.069065] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.571169] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97be36bb-9aa7-4ca4-9b9b-f2f13467259b: rpc.has_security_group_logging(os_id): False [ 1109.592601] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.593071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.593177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.593459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.593583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.593938] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.594122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.594241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.594481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.594629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.594806] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1109.659269] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.659414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.659485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.659699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.659850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.673477] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1110.318212] env[69255]: INFO networking_nsxv3.common.synchronization [None req-30deb13a-d018-4c9e-857c-550c7736e40a None None] Enqueued Resource ID: 7eb87168-a5b2-47cc-b135-542cb96b7a13 with Priority: HIGHEST for action port [ 1110.318871] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eb87168-a5b2-47cc-b135-542cb96b7a13 with Priority: HIGHEST for action port [ 1110.319228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eb87168-a5b2-47cc-b135-542cb96b7a13 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.319381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eb87168-a5b2-47cc-b135-542cb96b7a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.319447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eb87168-a5b2-47cc-b135-542cb96b7a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.319729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eb87168-a5b2-47cc-b135-542cb96b7a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.319816] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eb87168-a5b2-47cc-b135-542cb96b7a13',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.822090] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7eb87168-a5b2-47cc-b135-542cb96b7a13 [ 1110.822417] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.822879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.822995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.825110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.825110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.825110] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7eb87168-a5b2-47cc-b135-542cb96b7a13 already deleted. [ 1110.825110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eb87168-a5b2-47cc-b135-542cb96b7a13" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.225711] env[69255]: INFO networking_nsxv3.common.synchronization [None req-bfc5d6d6-922a-43b5-b4ac-2aec6d9c1acc tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1111.226052] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1111.226476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.228709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.228709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.228709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.228709] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.256098] env[69255]: INFO networking_nsxv3.common.synchronization [req-afbbad5f-bbc8-490b-9cd9-ea9a5b13194b req-810b15d2-09ad-4e4d-806a-111c351bc0f9 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_members [ 1111.256664] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGHEST for action security_group_members [ 1111.257096] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.257754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.257865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.258884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.258884] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.258884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.258884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.258884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.258884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.259174] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.338064] env[69255]: INFO networking_nsxv3.common.synchronization [None req-21985b9a-88de-4efb-8801-bba003ff94fd tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1111.338607] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1111.339147] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.339252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.694822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1111.694822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.750165] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.750429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.750429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.750639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.750735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.750821] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a already deleted. [ 1111.750900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.751071] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.751234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.751320] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.763227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.763384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.763448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.763676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.763763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.764223] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.764344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.764397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.765432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.765557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.765662] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 is going to be updated. [ 1111.800643] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.800643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.800643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.800643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.800933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.812892] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: IN_PROGRESS for 2s [ 1111.930543] env[69255]: INFO networking_nsxv3.common.synchronization [req-b6dc02c7-a226-4dc6-9276-3b3d8d8838bd req-6397a730-5172-4b4f-8186-0dd3cb93d648 tempest-ServerDiskConfigTestJSON-1013086766 tempest-ServerDiskConfigTestJSON-1013086766-project-member] Enqueued Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1111.930543] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981734c6-752d-40c2-ba2a-3f068cd82111 with Priority: HIGHEST for action security_group_members [ 1111.930543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-981734c6-752d-40c2-ba2a-3f068cd82111 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.930543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.930543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.930543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.930543] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.933137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.933137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.933372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.933494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.933632] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('981734c6-752d-40c2-ba2a-3f068cd82111',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.195032] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7e8524f3-981f-4d03-9485-67ecb33a318d None None] Enqueued Resource ID: bca1ef21-d746-475b-8b9f-d4d1a3f3673d with Priority: HIGHEST for action port [ 1112.195794] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca1ef21-d746-475b-8b9f-d4d1a3f3673d with Priority: HIGHEST for action port [ 1112.198620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca1ef21-d746-475b-8b9f-d4d1a3f3673d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.198775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca1ef21-d746-475b-8b9f-d4d1a3f3673d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.198919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca1ef21-d746-475b-8b9f-d4d1a3f3673d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.199811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca1ef21-d746-475b-8b9f-d4d1a3f3673d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.199811] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca1ef21-d746-475b-8b9f-d4d1a3f3673d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.284330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.284557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.284557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.284812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.284916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.285025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a already deleted. [ 1112.285112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.436411] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.436723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.436723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.436897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.436995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.437203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.437306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.437369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.437517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.437595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.437706] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 is going to be updated. [ 1112.480435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.480435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.480435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.480435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.480435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.490921] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: IN_PROGRESS for 2s [ 1112.703287] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bca1ef21-d746-475b-8b9f-d4d1a3f3673d [ 1112.703649] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.703812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.703884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.704125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.704219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.704321] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bca1ef21-d746-475b-8b9f-d4d1a3f3673d already deleted. [ 1112.704400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca1ef21-d746-475b-8b9f-d4d1a3f3673d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.826979] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 in Status: SUCCESS [ 1113.827927] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 deletion is rescheduled due to dependency. [ 1113.827927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.503036] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 981734c6-752d-40c2-ba2a-3f068cd82111 in Status: SUCCESS [ 1114.503036] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 981734c6-752d-40c2-ba2a-3f068cd82111 deletion is rescheduled due to dependency. [ 1114.503036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-981734c6-752d-40c2-ba2a-3f068cd82111" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.608080] env[69255]: INFO networking_nsxv3.common.synchronization [req-ae9225d0-035e-48e8-bf03-cf20d83bad8f req-ac0cc080-873e-41cb-aa54-3651fc490841 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_members [ 1114.608669] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_members [ 1114.611039] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.611039] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.611039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.611039] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.912509] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.912852] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.912852] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.913143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.913453] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.914415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.914415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.914415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.914415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.914415] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.914739] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.914739] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.914865] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.915033] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.915307] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.915822] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.935887] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.936278] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.936468] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.936692] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.937041] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5a857163-2240-489b-a90f-07db403882d6 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.937237] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.937368] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.937705] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.937867] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a857163-2240-489b-a90f-07db403882d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.113443] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.113613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.113916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.113916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.114065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.114183] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.114284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.114348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.114535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.114611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.114678] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 already deleted. [ 1115.114773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.440720] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.441080] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.441235] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.441528] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.441701] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.441867] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5a857163-2240-489b-a90f-07db403882d6 not found, creating... [ 1115.442167] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.442333] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.442457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.442687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.442833] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.443320] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.443501] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.443629] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.443857] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.444008] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.444189] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5a857163-2240-489b-a90f-07db403882d6 is going to be created. [ 1115.465715] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.465926] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.466068] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.466342] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.466623] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.467273] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.948521] env[69255]: INFO networking_nsxv3.common.synchronization [None req-9e1e937a-5798-4dcf-b7fc-b6d9ea802a36 None None] Enqueued Resource ID: ed86a4f7-061b-4237-87e0-4b89bee15c79 with Priority: HIGHEST for action port [ 1115.949204] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed86a4f7-061b-4237-87e0-4b89bee15c79 with Priority: HIGHEST for action port [ 1115.949549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed86a4f7-061b-4237-87e0-4b89bee15c79 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.949679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed86a4f7-061b-4237-87e0-4b89bee15c79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.949752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed86a4f7-061b-4237-87e0-4b89bee15c79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.950473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed86a4f7-061b-4237-87e0-4b89bee15c79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.950598] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed86a4f7-061b-4237-87e0-4b89bee15c79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.167232] env[69255]: INFO networking_nsxv3.common.synchronization [req-ae9225d0-035e-48e8-bf03-cf20d83bad8f req-aff91538-9c3e-4910-9441-4772cc447a7b service nova] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_rules [ 1116.167425] env[69255]: INFO networking_nsxv3.common.synchronization [req-ae9225d0-035e-48e8-bf03-cf20d83bad8f req-aff91538-9c3e-4910-9441-4772cc447a7b service nova] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_members [ 1116.167574] env[69255]: INFO networking_nsxv3.common.synchronization [req-ae9225d0-035e-48e8-bf03-cf20d83bad8f req-aff91538-9c3e-4910-9441-4772cc447a7b service nova] Enqueued Resource ID: 5a857163-2240-489b-a90f-07db403882d6 with Priority: HIGHEST for action port [ 1116.167898] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_rules [ 1116.168150] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_members [ 1116.169245] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a857163-2240-489b-a90f-07db403882d6 with Priority: HIGHEST for action port [ 1116.169815] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.170014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.170112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.170365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.170475] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.171703] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.171974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.171974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.175870] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.175870] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.175870] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a857163-2240-489b-a90f-07db403882d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.175870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.175870] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a857163-2240-489b-a90f-07db403882d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.453442] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed86a4f7-061b-4237-87e0-4b89bee15c79 [ 1116.453442] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.453442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.453442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.453442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.453442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.453760] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed86a4f7-061b-4237-87e0-4b89bee15c79 already deleted. [ 1116.453760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed86a4f7-061b-4237-87e0-4b89bee15c79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.677459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.677609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.677907] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a857163-2240-489b-a90f-07db403882d6 with status ACTIVE [ 1116.678124] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.678243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.678306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.678540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.678592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.678763] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.678860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.678920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.679084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.679164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.679344] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.679437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.679499] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.679637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.679713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.679798] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a857163-2240-489b-a90f-07db403882d6 is going to be updated. [ 1116.681180] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.703939] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.704096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.704191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.704374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.704544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.704711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a857163-2240-489b-a90f-07db403882d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.184210] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.290009] env[69255]: INFO networking_nsxv3.common.synchronization [req-8a3ad12c-125e-46ad-a558-e1c96b0dc998 req-c3d88f68-56da-4bd0-9675-5b18191006f0 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1117.290555] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1117.293339] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.293339] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.293339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.293339] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.687657] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.687819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.687890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.688130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.688231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.688437] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 is going to be created. [ 1117.731079] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.731362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.731362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.731543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.731956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.744945] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 in Status: UNINITIALIZED for 2s [ 1117.797657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.843299] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.843299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.843299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.843299] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.843299] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.845181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.845181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.845181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.845398] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.845448] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.845572] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.845684] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.845793] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.845910] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.846062] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.846218] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.868149] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.868490] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.868676] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.868971] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.869394] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5f227528-db1c-4233-a5da-02752a0bfe43 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.869711] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.869943] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.870488] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.870713] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f227528-db1c-4233-a5da-02752a0bfe43',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.203194] env[69255]: INFO networking_nsxv3.common.synchronization [None req-2e7c96ae-58e0-48a4-ae48-6db4ca1a3b04 None None] Enqueued Resource ID: cccaf03b-cf2e-4bb5-9be5-ee639554e97a with Priority: HIGHEST for action port [ 1118.203194] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cccaf03b-cf2e-4bb5-9be5-ee639554e97a with Priority: HIGHEST for action port [ 1118.205029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cccaf03b-cf2e-4bb5-9be5-ee639554e97a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.205029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cccaf03b-cf2e-4bb5-9be5-ee639554e97a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.205029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cccaf03b-cf2e-4bb5-9be5-ee639554e97a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.205029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cccaf03b-cf2e-4bb5-9be5-ee639554e97a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.205029] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cccaf03b-cf2e-4bb5-9be5-ee639554e97a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.300197] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.374014] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.374394] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.374548] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.374902] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.375129] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.375350] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5f227528-db1c-4233-a5da-02752a0bfe43 not found, creating... [ 1118.375733] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.375976] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.376168] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.376465] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.376722] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.377144] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.377366] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.377549] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.377928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.378167] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.378374] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5f227528-db1c-4233-a5da-02752a0bfe43 is going to be created. [ 1118.400912] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.401185] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.401338] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.401627] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.401863] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.402121] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.707248] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cccaf03b-cf2e-4bb5-9be5-ee639554e97a [ 1118.707974] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.708189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.708264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.708496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.709046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.709166] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cccaf03b-cf2e-4bb5-9be5-ee639554e97a already deleted. [ 1118.709547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cccaf03b-cf2e-4bb5-9be5-ee639554e97a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.804712] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.804896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.804934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.805193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.805294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.805407] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1118.836217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.836401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.836461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.836754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.836964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.847758] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1118.860481] env[69255]: INFO networking_nsxv3.common.synchronization [None req-f0d36b92-f864-4ab0-ad97-549953b5022d tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_rules [ 1118.861508] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_rules [ 1118.861508] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.861508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.861684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.862383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.862383] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.986672] env[69255]: INFO networking_nsxv3.common.synchronization [None req-06881a1c-d730-4d3d-b30a-2f52461c13bc tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_rules [ 1118.987216] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_rules [ 1118.987557] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.987677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.172651] env[69255]: INFO networking_nsxv3.common.synchronization [req-8a3ad12c-125e-46ad-a558-e1c96b0dc998 req-378c04ca-da7f-46b1-8add-f89d46553928 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1119.173268] env[69255]: INFO networking_nsxv3.common.synchronization [req-8a3ad12c-125e-46ad-a558-e1c96b0dc998 req-378c04ca-da7f-46b1-8add-f89d46553928 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1119.173268] env[69255]: INFO networking_nsxv3.common.synchronization [req-8a3ad12c-125e-46ad-a558-e1c96b0dc998 req-378c04ca-da7f-46b1-8add-f89d46553928 service nova] Enqueued Resource ID: 5f227528-db1c-4233-a5da-02752a0bfe43 with Priority: HIGHEST for action port [ 1119.173268] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1119.173468] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1119.173468] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f227528-db1c-4233-a5da-02752a0bfe43 with Priority: HIGHEST for action port [ 1119.174459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.174590] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.174686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.175177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.175177] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.176205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.176293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.176535] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f227528-db1c-4233-a5da-02752a0bfe43 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.176621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.176687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.176863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.176941] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f227528-db1c-4233-a5da-02752a0bfe43',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.384369] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.384628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.384628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.384718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.384805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.384901] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 already deleted. [ 1119.384985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.385165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.385321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.385403] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.683117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.683117] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f227528-db1c-4233-a5da-02752a0bfe43 with status ACTIVE [ 1119.683117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.683117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.683117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.683117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.683711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.683711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.683711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.683711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.683711] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f227528-db1c-4233-a5da-02752a0bfe43 is going to be updated. [ 1119.705677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.705677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.705677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.705677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.705677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.705677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f227528-db1c-4233-a5da-02752a0bfe43" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.755616] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 in Status: SUCCESS [ 1119.755823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.755823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.756048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.756238] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.756354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.756419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.756680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.756771] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.756841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.756932] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.919708] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.919906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.920030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.920300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.920419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.920547] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 already deleted. [ 1119.920656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.259592] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.761250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6: rpc.has_security_group_logging(os_id): False [ 1120.780327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.780535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.780610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.780812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.780977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.781186] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.781279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.781348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.781498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.781576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.781664] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 is going to be created. [ 1120.860972] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1120.861728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.861728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.861728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.861892] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.861957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.862010] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.862161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.862247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.862356] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.873154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.873316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.873316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.873507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.873692] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.887023] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 in Status: IN_PROGRESS for 2s [ 1121.365294] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.867551] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.369859] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.370075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.370145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.370642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.370642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.370642] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1122.541831] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.542036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.542112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.542327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.542477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.554932] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1122.813236] env[69255]: INFO networking_nsxv3.common.synchronization [req-4de5537b-fab2-4e0b-91d5-a5c182909e46 req-a5f2a4f6-efa3-4249-808e-130f9fbb934f tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1122.813236] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1122.813236] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.813236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.813236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.813236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.813236] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.813236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.813236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.813236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.816676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.816676] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.901705] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 in Status: SUCCESS [ 1122.902508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.233315] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.233519] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.233710] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.234117] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.234700] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.234834] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.234939] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.235322] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.235470] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.235765] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.235933] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.236094] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.236232] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.236407] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.236588] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.236754] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.258687] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.258783] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.258970] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.259215] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.259539] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-cadf202c-1b9e-4c0e-92c8-53217aa146a8 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.259719] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.259845] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.260205] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.260349] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cadf202c-1b9e-4c0e-92c8-53217aa146a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.319849] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.320257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.320688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.320994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.321135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.321385] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.321505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.321571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.321810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.321949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.322128] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a already deleted. [ 1123.322538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.762850] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.763104] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.763243] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.763530] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.763687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.763853] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port cadf202c-1b9e-4c0e-92c8-53217aa146a8 not found, creating... [ 1123.764171] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.764342] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.764466] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.764791] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.764934] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.765245] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.765409] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.765536] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.765764] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.765902] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.766062] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 is going to be created. [ 1123.801717] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.801999] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.802158] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.802459] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.802682] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.802985] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.525541] env[69255]: INFO networking_nsxv3.common.synchronization [req-4de5537b-fab2-4e0b-91d5-a5c182909e46 req-3cacf71a-f9f1-4039-b754-152084f20330 service nova] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1124.525541] env[69255]: INFO networking_nsxv3.common.synchronization [req-4de5537b-fab2-4e0b-91d5-a5c182909e46 req-3cacf71a-f9f1-4039-b754-152084f20330 service nova] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1124.526235] env[69255]: INFO networking_nsxv3.common.synchronization [req-4de5537b-fab2-4e0b-91d5-a5c182909e46 req-3cacf71a-f9f1-4039-b754-152084f20330 service nova] Enqueued Resource ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 with Priority: HIGHEST for action port [ 1124.530041] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1124.530041] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1124.530041] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 with Priority: HIGHEST for action port [ 1124.530041] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.530041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.530041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.530041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.530041] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.532265] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.532430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.532513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.532762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.532921] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.533101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.533101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.533254] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.533369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.533455] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.537958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cadf202c-1b9e-4c0e-92c8-53217aa146a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.537958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.537958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.537958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.537958] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cadf202c-1b9e-4c0e-92c8-53217aa146a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.564761] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1124.565184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.565437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.565690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.565887] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.566012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.566086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.566243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.566324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566561] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.926927] env[69255]: INFO networking_nsxv3.common.synchronization [req-56a01c71-5b63-43cf-b857-19228e39da2f req-1c45f343-3728-4f8e-ba22-c3ade57a83d8 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1124.927721] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1124.928173] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.928311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.928380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.928644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.928810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.930573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.930652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.930828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.930917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.931032] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.038681] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.039752] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.039878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.041354] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cadf202c-1b9e-4c0e-92c8-53217aa146a8 with status ACTIVE [ 1125.041436] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.041552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.041614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.041820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.041910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.042099] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.042196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.042261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.042420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.042507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.042685] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.042786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.042849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.042971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.043057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.043144] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 is going to be updated. [ 1125.070079] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.070337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.070337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.070519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.070685] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.070781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.070847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.070994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.071096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.071184] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.071334] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.071427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.071490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.071630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.071768] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.071857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.071913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.072065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.072142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.072223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.072310] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.077320] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.077500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.077500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.077677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.077817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.077982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.363431] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.363431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.363431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.364762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.364762] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.364762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.364762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.364762] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.365146] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.365146] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.365146] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.365250] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.365356] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.365472] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.365582] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.365720] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.385405] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.385590] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1125.385717] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.385906] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.386246] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.386478] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.386617] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.386952] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.387109] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9904a6d-cfe3-446b-ba49-4ba3fba5a474',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.433990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.433990] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.433990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.434452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.434452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.434452] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 already deleted. [ 1125.434452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.542823] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.576219] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1125.595036] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.597020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.597020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.597873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.598148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.600082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.600082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.600082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.600082] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1125.665588] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.665718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.665778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.665995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.666161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.682876] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1125.891058] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.891058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.891058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.892034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.892034] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.892034] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port c9904a6d-cfe3-446b-ba49-4ba3fba5a474 not found, creating... [ 1125.892034] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.892276] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.892341] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.892580] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.892728] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.893183] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.893407] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.893537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.893760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.893899] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.894059] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 is going to be created. [ 1125.914386] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.914663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.915125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.915125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.915329] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.915548] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.047190] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.047411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.047453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.047665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.047758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.047851] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a is going to be created. [ 1126.094400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.094625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.094668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.094904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.095097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.104775] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: UNINITIALIZED for 2s [ 1126.980345] env[69255]: INFO networking_nsxv3.common.synchronization [req-56a01c71-5b63-43cf-b857-19228e39da2f req-8a38949d-3735-4667-93f3-21b9e8b68462 service nova] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_rules [ 1126.980595] env[69255]: INFO networking_nsxv3.common.synchronization [req-56a01c71-5b63-43cf-b857-19228e39da2f req-8a38949d-3735-4667-93f3-21b9e8b68462 service nova] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1126.980673] env[69255]: INFO networking_nsxv3.common.synchronization [req-56a01c71-5b63-43cf-b857-19228e39da2f req-8a38949d-3735-4667-93f3-21b9e8b68462 service nova] Enqueued Resource ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with Priority: HIGHEST for action port [ 1126.980908] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_rules [ 1126.981061] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1126.981207] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with Priority: HIGHEST for action port [ 1126.981852] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.982846] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.982938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.985597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.985597] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.985597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.985597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.985597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.985597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.985597] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.985597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.986072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.986072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.986162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.986259] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.987203] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.987441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.987524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.987679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.987914] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9904a6d-cfe3-446b-ba49-4ba3fba5a474',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.319873] env[69255]: INFO networking_nsxv3.common.synchronization [req-6e971a55-656f-427f-b2ec-93f926019344 req-67cae3be-9f94-4ffa-b248-b68c7de51b94 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1127.321300] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1127.321864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.322047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.322144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.322515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.322722] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.322852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.322940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.323239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.323362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.323489] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.489722] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.489894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.490116] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.491609] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with status ACTIVE [ 1127.491873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.492049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.492266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.492387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.492510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.492708] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.492833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.492950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.493118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.493223] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.493527] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.493527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.493665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.493789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.493898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.494040] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 is going to be updated. [ 1127.515626] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.515769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.515840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.516359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.516359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.516527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.623925] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.624278] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.624278] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.624594] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.624864] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.625039] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.625166] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.625389] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.625546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.625754] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.625873] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.625987] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.626112] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.626229] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.626412] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.626556] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.658747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.658924] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.659091] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.659278] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.659602] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.659865] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.659997] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.660345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.660493] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a4af7df-81a8-477d-a2e3-ce4ee43d49d4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.700463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1127.700698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.827920] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.827920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.827920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.828171] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.828246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.828554] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.828773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.828838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.829076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.829177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.829318] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 already deleted. [ 1127.829411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.992221] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.118025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: SUCCESS [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.118025] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.118025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.118025] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.163358] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.165079] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.167019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.167019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.167019] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.167019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 not found, creating... [ 1128.167848] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.168318] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.168775] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.169313] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.169701] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.170800] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.171333] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.171701] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.172216] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.172614] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.175342] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 is going to be created. [ 1128.194424] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.197134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.197134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.197134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.197134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.197597] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.494620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.494836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.494915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.495174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.495273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.495384] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be created. [ 1128.519550] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.519550] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.519703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.519874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.520081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.529954] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: UNINITIALIZED for 2s [ 1128.621615] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.089447] env[69255]: INFO networking_nsxv3.common.synchronization [req-6e971a55-656f-427f-b2ec-93f926019344 req-9cc083a8-cee7-4ea4-a63c-f7c08d988280 service nova] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_rules [ 1129.089808] env[69255]: INFO networking_nsxv3.common.synchronization [req-6e971a55-656f-427f-b2ec-93f926019344 req-9cc083a8-cee7-4ea4-a63c-f7c08d988280 service nova] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1129.089808] env[69255]: INFO networking_nsxv3.common.synchronization [req-6e971a55-656f-427f-b2ec-93f926019344 req-9cc083a8-cee7-4ea4-a63c-f7c08d988280 service nova] Enqueued Resource ID: 2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 with Priority: HIGHEST for action port [ 1129.090366] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_rules [ 1129.090522] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1129.090649] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 with Priority: HIGHEST for action port [ 1129.090950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.093831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.093831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.093981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.094122] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.095288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.095875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.095991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.096238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.096454] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.096757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.096886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.097208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.097208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.097403] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.100693] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.100985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.101122] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.101335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.101424] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a4af7df-81a8-477d-a2e3-ce4ee43d49d4',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.124560] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1d269b6-2543-4ac4-ba27-81ea5467b07a: rpc.has_security_group_logging(os_id): False [ 1129.145368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.145561] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.145635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.145911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.146025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.146325] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.146447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.146519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.146724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.146845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.146940] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a is going to be created. [ 1129.235083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.235179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.235212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.235803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.235803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.267811] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: IN_PROGRESS for 2s [ 1129.534168] env[69255]: INFO networking_nsxv3.common.synchronization [req-b2a009b6-23fa-47e0-88c5-5670a8293a56 req-1dfbfa0b-29d0-41d3-a885-5a4d8c97c17e tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_members [ 1129.534168] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_members [ 1129.534168] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.535419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.535684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.536033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.536326] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.536559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.538316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.538316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.538316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.538316] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.605765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.605765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.605999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.606771] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 with status ACTIVE [ 1129.606873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.606980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.607061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.607258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.607384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.607611] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.607716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.607780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.607940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.608040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.608227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.608322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.608389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.608523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.608596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.608677] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a4af7df-81a8-477d-a2e3-ce4ee43d49d4 is going to be updated. [ 1129.632745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.632885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.632949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.633183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.633326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.633490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a4af7df-81a8-477d-a2e3-ce4ee43d49d4" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.938100] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.938330] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.938516] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.938781] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.939120] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.939302] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.939429] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.939663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.939813] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.940040] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.940164] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.940283] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.940399] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.940517] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.940631] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.940774] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.970407] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.970612] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.970749] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.970954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.971312] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-4a28ee9c-ed2d-470e-8c51-80d44affb612 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.971526] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.971653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.972030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.972192] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a28ee9c-ed2d-470e-8c51-80d44affb612',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.039649] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.040410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.040410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.040410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.040410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.040410] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.040410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.040410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.040744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.040744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.040744] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 already deleted. [ 1130.040897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.111838] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.474643] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.474903] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.475044] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.475381] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.475583] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.475760] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 4a28ee9c-ed2d-470e-8c51-80d44affb612 not found, creating... [ 1130.476045] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.476218] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.476408] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.476682] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.476843] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.477189] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.477391] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.477520] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.477773] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.477923] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.478097] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 4a28ee9c-ed2d-470e-8c51-80d44affb612 is going to be created. [ 1130.500521] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.500768] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.500907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.501317] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.501479] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.501724] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.542770] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1130.542770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.542770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.543106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.543312] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.543451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.543526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.543732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.543825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.543918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.544024] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.613162] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.613380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.613423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.613698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.613816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.613990] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be created. [ 1130.646794] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.647135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.647253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.647578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.647890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.672893] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: UNINITIALIZED for 2s [ 1130.721696] env[69255]: INFO networking_nsxv3.common.synchronization [req-6da6fff2-ab56-4a85-b3ed-ce4398feb9da req-787659a4-4dcd-4933-8634-8dafa25333ca tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1130.722390] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1130.722683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.722816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.722882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.723193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.723774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.723774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.723774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.723774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.723957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.724078] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.046714] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.046962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.047022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.047382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.047651] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.047827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.047938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.048221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.048376] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.048585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.048755] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.048932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.049018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.049319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.049459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.049608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.049706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.049873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.049990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.050152] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.050292] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.217628] env[69255]: INFO networking_nsxv3.common.synchronization [req-b2a009b6-23fa-47e0-88c5-5670a8293a56 req-216630fb-4936-4c31-9085-abd653ab9e3a service nova] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_rules [ 1131.217936] env[69255]: INFO networking_nsxv3.common.synchronization [req-b2a009b6-23fa-47e0-88c5-5670a8293a56 req-216630fb-4936-4c31-9085-abd653ab9e3a service nova] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_members [ 1131.217936] env[69255]: INFO networking_nsxv3.common.synchronization [req-b2a009b6-23fa-47e0-88c5-5670a8293a56 req-216630fb-4936-4c31-9085-abd653ab9e3a service nova] Enqueued Resource ID: 4a28ee9c-ed2d-470e-8c51-80d44affb612 with Priority: HIGHEST for action port [ 1131.218501] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_rules [ 1131.218667] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_members [ 1131.218770] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a28ee9c-ed2d-470e-8c51-80d44affb612 with Priority: HIGHEST for action port [ 1131.219066] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.219191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.219259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.219467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.219549] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.220715] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.220852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.220937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.221170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.221326] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.221444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.221513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.221706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.221816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.221999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.222728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a28ee9c-ed2d-470e-8c51-80d44affb612 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.222864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.222893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.223057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.223133] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a28ee9c-ed2d-470e-8c51-80d44affb612',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.226667] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.285357] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: SUCCESS [ 1131.285584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.552548] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6627935d-0b5f-4439-bda8-bf197f556287: rpc.has_security_group_logging(os_id): False [ 1131.574161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.574161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.574161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.574161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.574161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.574161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.574575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.574575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.574575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.574575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.574989] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.574989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.574989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.574989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.575252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.575252] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.575383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.575383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.575515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.575589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.575674] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be created. [ 1131.650234] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.650457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.650654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.650992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.651375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.663192] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1131.725776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.725776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.725776] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.726689] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a28ee9c-ed2d-470e-8c51-80d44affb612 with status ACTIVE [ 1131.726917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.727062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.727325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.727543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.727697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.727871] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.728020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.728089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.728316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.728438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.728671] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.728886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.728886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.729085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.729212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.729262] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a28ee9c-ed2d-470e-8c51-80d44affb612 is going to be updated. [ 1131.731211] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.798592] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.798832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.798936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.799229] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.799454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.799697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a28ee9c-ed2d-470e-8c51-80d44affb612" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.231626] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.233008] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.233203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.233341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.233700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.233831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.233971] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1132.274037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.274344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.274427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.274660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.274816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.291672] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1132.684515] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1132.684727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.684924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.685121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.685304] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.685424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.685489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.685804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.685904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.686010] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.686115] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.737021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.737311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.737311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.737549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.737650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.737752] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 is going to be created. [ 1132.767922] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.768316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.768316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.768538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.768701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.779956] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6428cece-54ff-401f-affd-cd4584d1d303 in Status: UNINITIALIZED for 2s [ 1133.188310] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.188630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.188725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.188965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.189164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.189311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.189386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.189504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.189594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.190069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.190069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.190069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.190069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.190378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.190378] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.190378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.190573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.190573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.190672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.190672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.190763] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.678243] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1133.678744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.696272] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27450723-a78e-460e-9cf1-b908c9e86164: rpc.has_security_group_logging(os_id): False [ 1133.716237] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.716430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.716538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.716796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.717021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.717189] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.717336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.717420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.717648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.717733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.717979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.718123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.718214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.718365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.718631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.718715] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.718812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.718887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.719077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.719182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.719283] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be created. [ 1133.836066] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.836288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.836405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.836666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.836899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.851520] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: IN_PROGRESS for 2s [ 1134.302680] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1134.303032] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.789321] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6428cece-54ff-401f-affd-cd4584d1d303 in Status: SUCCESS [ 1134.789712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.789712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.789921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.790126] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.790243] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.790311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.790466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.790547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.790633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.790733] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.292734] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.796286] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6428cece-54ff-401f-affd-cd4584d1d303: rpc.has_security_group_logging(os_id): False [ 1135.817134] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.817315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.817390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.817677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.817774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.818053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.818153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.818260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.818392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.818525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.818804] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 is going to be created. [ 1135.866389] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1135.866658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.897673] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.897867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.897939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.898139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.898326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.913104] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6428cece-54ff-401f-affd-cd4584d1d303 in Status: IN_PROGRESS for 2s [ 1136.219490] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1136.219708] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1137.942770] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6428cece-54ff-401f-affd-cd4584d1d303 in Status: SUCCESS [ 1137.943248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.453742] env[69255]: INFO networking_nsxv3.common.synchronization [req-30a040bc-e225-4fe4-9644-62285847e1cc req-f84a2170-20fc-4ba7-b84b-4f3e4581dca8 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1140.454461] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1140.454829] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.455625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.455756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.456017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.456319] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.456448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.456510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.456721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.456819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.456917] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.931053] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.931053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.931053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.931053] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.931053] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.931591] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.931871] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.932254] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.932593] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.932929] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.933230] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.933531] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.933906] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.934250] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.934547] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.934814] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.961031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.961031] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.961031] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.961031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.961031] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.961031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.961031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.961031] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.961561] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dedbac4-75a2-42aa-bc87-8dbdc7dad6db',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.963579] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.465384] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.466878] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.469033] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 5dedbac4-75a2-42aa-bc87-8dbdc7dad6db not found, creating... [ 1141.469033] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.469033] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.469033] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.469467] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.469467] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.469467] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.469551] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.469679] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 5dedbac4-75a2-42aa-bc87-8dbdc7dad6db is going to be created. [ 1141.471424] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.496203] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.496203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.496203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.496203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.496203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.496203] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.975029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.975029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.975029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.975286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.975286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.975356] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1142.005040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.005209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.005209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.005379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.005532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.015127] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1142.188143] env[69255]: INFO networking_nsxv3.common.synchronization [req-30a040bc-e225-4fe4-9644-62285847e1cc req-1ab4a0f5-bba9-4255-9c87-ac49f0ff3710 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1142.188463] env[69255]: INFO networking_nsxv3.common.synchronization [req-30a040bc-e225-4fe4-9644-62285847e1cc req-1ab4a0f5-bba9-4255-9c87-ac49f0ff3710 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1142.188702] env[69255]: INFO networking_nsxv3.common.synchronization [req-30a040bc-e225-4fe4-9644-62285847e1cc req-1ab4a0f5-bba9-4255-9c87-ac49f0ff3710 service nova] Enqueued Resource ID: 5dedbac4-75a2-42aa-bc87-8dbdc7dad6db with Priority: HIGHEST for action port [ 1142.189729] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1142.189926] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1142.190093] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dedbac4-75a2-42aa-bc87-8dbdc7dad6db with Priority: HIGHEST for action port [ 1142.190499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.190684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.190795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.191195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.191239] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.192656] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.192811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.193151] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.193401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.193521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.193819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.193923] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dedbac4-75a2-42aa-bc87-8dbdc7dad6db',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.696397] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.696724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.696862] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dedbac4-75a2-42aa-bc87-8dbdc7dad6db with status ACTIVE [ 1142.697159] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.697325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.697427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.697744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.697887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.698170] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.698319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.698418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.698657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.698772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.699086] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.699459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.699459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.699591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.699687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.699812] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dedbac4-75a2-42aa-bc87-8dbdc7dad6db is going to be updated. [ 1142.720874] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.721101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.721101] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.721321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.721451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.721617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dedbac4-75a2-42aa-bc87-8dbdc7dad6db" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.027093] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1144.027093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.027093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.027733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.027733] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.027733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.027733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.027953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.027953] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.028122] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.531138] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.033721] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.539338] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.539537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.539579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.539790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.539881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.539983] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1145.578304] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.578509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.578566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.578859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.579104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.590325] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1147.126817] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_members [ 1147.127251] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.127695] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_members [ 1147.127839] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.128143] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab33388-efd6-4dd9-9543-5508842b48e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.128273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.128343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.128639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.128805] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.128909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.128973] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.129302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.129365] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.129472] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.130441] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.130587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.130687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.130923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.131127] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.131256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.131349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.131540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.131647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.131770] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.187561] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_rules [ 1147.187748] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.187891] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_rules [ 1147.188058] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_members [ 1147.188186] env[69255]: INFO networking_nsxv3.common.synchronization [req-12d069df-792d-4ad3-905d-0bccce3ee682 req-6d45521e-aba5-4e0b-ba7c-7986a6ce78f4 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with Priority: HIGHEST for action port [ 1147.188680] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_rules [ 1147.188866] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_rules [ 1147.189053] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with Priority: HIGHEST for action port [ 1147.189169] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.189264] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_members [ 1147.189542] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.189664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.189723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.189936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.190018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.190863] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab33388-efd6-4dd9-9543-5508842b48e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.190993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.191042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.191268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.191340] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.192124] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.192313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.192313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.192470] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.192507] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9904a6d-cfe3-446b-ba49-4ba3fba5a474',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.332948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.333760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.333760] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab33388-efd6-4dd9-9543-5508842b48e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.333760] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.477969] env[69255]: INFO networking_nsxv3.common.synchronization [req-59563884-952c-4247-86af-36a45cc6c790 req-20f168e6-1c4a-4712-99f9-479881dff409 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_members [ 1147.477969] env[69255]: INFO networking_nsxv3.common.synchronization [req-59563884-952c-4247-86af-36a45cc6c790 req-20f168e6-1c4a-4712-99f9-479881dff409 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.477969] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab33388-efd6-4dd9-9543-5508842b48e2 with Priority: HIGHEST for action security_group_members [ 1147.478153] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.478483] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab33388-efd6-4dd9-9543-5508842b48e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.478614] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.478875] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.478990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.526881] env[69255]: INFO networking_nsxv3.common.synchronization [req-59563884-952c-4247-86af-36a45cc6c790 req-20f168e6-1c4a-4712-99f9-479881dff409 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_rules [ 1147.527373] env[69255]: INFO networking_nsxv3.common.synchronization [req-59563884-952c-4247-86af-36a45cc6c790 req-20f168e6-1c4a-4712-99f9-479881dff409 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.527672] env[69255]: INFO networking_nsxv3.common.synchronization [req-59563884-952c-4247-86af-36a45cc6c790 req-20f168e6-1c4a-4712-99f9-479881dff409 tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with Priority: HIGHEST for action port [ 1147.528526] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_rules [ 1147.528722] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1147.528867] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with Priority: HIGHEST for action port [ 1147.529283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.529425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.529721] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.529935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.530255] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.530416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.602134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1147.602381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.602566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.602839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.603063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.603189] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.603246] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.603412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.603492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.603577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.603666] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.633554] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.634682] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.838386] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.838564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.838875] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab33388-efd6-4dd9-9543-5508842b48e2 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.839022] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.839179] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with status ACTIVE [ 1147.839347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.839449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.839517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.839731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.840062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.840062] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.840220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.840220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.840369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.840463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.840667] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.840773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.840837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.841057] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.841144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.841267] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 is going to be updated. [ 1147.863353] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.863563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.863701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.863852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.864014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.864187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.864344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.864504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.864587] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9904a6d-cfe3-446b-ba49-4ba3fba5a474',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.105742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.105957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.106024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.107738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.107738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.107738] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.107738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.108493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.108493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.108493] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.140854] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.141757] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.367567] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9904a6d-cfe3-446b-ba49-4ba3fba5a474 with status ACTIVE [ 1148.368016] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.368210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.368300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.368549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.368647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.368846] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.368970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.369069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.369227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.369306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.369499] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.369609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.369670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.369829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.369905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.369993] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9904a6d-cfe3-446b-ba49-4ba3fba5a474 is going to be updated. [ 1148.391305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.391498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.391498] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.391799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.391979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.392412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9904a6d-cfe3-446b-ba49-4ba3fba5a474" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.610239] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1148.636671] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.636866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.636918] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.637199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.637348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.637582] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.637688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.637751] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.637921] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.637998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.638229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.638321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.638396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.638521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.638595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.638775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.638867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.638923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.639086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.639158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.639247] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1148.643137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.643256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.643356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.643487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.643570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.643666] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be updated. [ 1148.644931] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.645055] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.645217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.645270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.645357] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.645446] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 is going to be created. [ 1148.684726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.684886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.685172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.685172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.685397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.696268] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab33388-efd6-4dd9-9543-5508842b48e2 in Status: UNINITIALIZED for 2s [ 1148.697268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.697428] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.697467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.698231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.698231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.709465] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1148.726771] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.726946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.726946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.727238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.727397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.742010] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1150.708681] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab33388-efd6-4dd9-9543-5508842b48e2 in Status: SUCCESS [ 1150.708990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.709197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.709527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.709804] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.709998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.710137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.710402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.710549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.710710] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.722517] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1150.722749] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.723054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.723269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.723566] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.723566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.723786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.723786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.723886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.723932] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.758931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1150.759041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.214569] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.214790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.214790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.214996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.215107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.215305] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.215405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.215469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.215628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.215705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.215826] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 is going to be deleted. [ 1151.226450] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.254536] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.254766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.254766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.254941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.255048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.255174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.255651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.255823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.256014] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.256126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.256188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.256332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.256412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.256501] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.730376] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.758465] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.758748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.758936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.759103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.759196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.759408] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.759506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.759569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.759715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.759792] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.759879] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 already deleted. [ 1151.759957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.760598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.760769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.760923] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.761135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.761135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.761277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.761323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.761386] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.232899] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.233146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.233146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.233385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.233476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.233578] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be updated. [ 1152.264072] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.264291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.264340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.264766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.264766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.264967] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.265100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.265188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.265450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.265540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.265645] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 already deleted. [ 1152.265727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.265822] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.281136] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.281390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.281390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.281679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.281876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.292633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1152.529629] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1152.529719] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1152.768888] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dab33388-efd6-4dd9-9543-5508842b48e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.000208] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa424184-7e53-4587-9e6d-1168f0298f2b req-6f668ffa-921f-415f-8330-3d6dcbc7701c tempest-ServerRescueTestJSONUnderV235-653355629 tempest-ServerRescueTestJSONUnderV235-653355629-project-member] Enqueued Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1153.001033] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6627935d-0b5f-4439-bda8-bf197f556287 with Priority: HIGHEST for action security_group_members [ 1153.001376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.001496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.270851] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dab33388-efd6-4dd9-9543-5508842b48e2: rpc.has_security_group_logging(os_id): False [ 1153.290630] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.290867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.291072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.291167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.291368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.291477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.291540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.291693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.291770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.291857] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 is going to be created. [ 1153.311395] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/dab33388-efd6-4dd9-9543-5508842b48e2], does not exist path=[/infra/domains/default/groups/dab33388-efd6-4dd9-9543-5508842b48e2]."\n}' [ 1153.311395] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dab33388-efd6-4dd9-9543-5508842b48e2 [ 1153.311507] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1153.360084] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.360330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.360452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.360730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.362435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.362927] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.363144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.363282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.363559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.363684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.364029] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.364564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.364564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.364564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.364676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.364776] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab33388-efd6-4dd9-9543-5508842b48e2 is going to be created. [ 1153.383577] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/dab33388-efd6-4dd9-9543-5508842b48e2], does not exist path=[/infra/domains/default/groups/dab33388-efd6-4dd9-9543-5508842b48e2]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dab33388-efd6-4dd9-9543-5508842b48e2 [ 1153.383769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab33388-efd6-4dd9-9543-5508842b48e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.383988] env[69255]: Traceback (most recent call last): [ 1153.384075] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1153.384075] env[69255]: return func(*args, **kwargs) [ 1153.384075] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1153.384075] env[69255]: res.raise_for_status() [ 1153.384075] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1153.384075] env[69255]: raise HTTPError(http_error_msg, response=self) [ 1153.384075] env[69255]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dab33388-efd6-4dd9-9543-5508842b48e2 [ 1153.384075] env[69255]: During handling of the above exception, another exception occurred: [ 1153.384075] env[69255]: Traceback (most recent call last): [ 1153.384075] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1153.384075] env[69255]: listener.cb(fileno) [ 1153.384075] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1153.384075] env[69255]: result = function(*args, **kwargs) [ 1153.384075] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1153.384075] env[69255]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1153.384075] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1153.384075] env[69255]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1153.384075] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1153.384075] env[69255]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1153.384075] env[69255]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1153.384075] env[69255]: res.raise_for_status() [ 1153.384075] env[69255]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1153.384075] env[69255]: raise HTTPError(http_error_msg, response=self) [ 1153.384075] env[69255]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dab33388-efd6-4dd9-9543-5508842b48e2 [ 1153.384075] env[69255]: Removing descriptor: 33 [ 1154.303210] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1154.303643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.303643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.303803] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.303985] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.304212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.304212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.304338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.304452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.304506] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.806547] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.806724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.806764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.807065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.826255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.826462] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.826576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.826641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.826882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.826951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.827031] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be updated. [ 1154.857839] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.858062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.858181] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.858360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.858523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.868960] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1156.588339] env[69255]: INFO networking_nsxv3.common.synchronization [req-c093c414-a588-4302-b02a-02674b06f6cb req-87cadea3-295a-4494-ad0a-b456725b4e30 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1156.588900] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1156.589218] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.589366] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.589430] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.589639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.589787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.589885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.590048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.590206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.590290] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.590381] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.879575] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1156.879828] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 deletion is rescheduled due to dependency. [ 1156.879828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.880028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.880345] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.880528] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.880644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.880706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.880861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.880941] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.881044] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.092785] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.092962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.093028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.093248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.114068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.114068] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.114068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.114068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.114068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.114068] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.114068] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be updated. [ 1157.142821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.143521] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.143608] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.143888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.144042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.154732] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: IN_PROGRESS for 2s [ 1157.382947] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.383164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.383281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.383468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.383558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.383766] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.383994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.383994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.384135] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.384190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.384251] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be updated. [ 1157.408368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.408559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.408559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.408769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.408908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.417585] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1157.900775] env[69255]: INFO networking_nsxv3.common.synchronization [req-2a13a1f4-359a-454d-8d9f-8fd23bb32a25 req-2beb2cfb-2fc0-49c1-b4c6-8d7f20e2db19 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1157.901397] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1157.901701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.901827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.901895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.902130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.902264] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.902360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.902421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.902567] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.902643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.902732] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.177595] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.177818] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.177929] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.178500] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.178802] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.179126] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.179126] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.179384] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.179474] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.179737] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.179799] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.179914] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.180114] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.180173] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.180243] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.180647] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.200314] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.200527] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.200664] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.200848] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.201193] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-7e85665e-95f7-4865-9666-421894f8afc7 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.201368] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.201631] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.201843] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.201987] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e85665e-95f7-4865-9666-421894f8afc7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.405280] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.704753] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.704753] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.704753] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.705083] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.705261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.705423] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 7e85665e-95f7-4865-9666-421894f8afc7 not found, creating... [ 1158.705692] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.705910] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.706058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.706300] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.706443] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.706743] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.706921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.707170] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.707280] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.707421] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.707567] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 7e85665e-95f7-4865-9666-421894f8afc7 is going to be created. [ 1158.731678] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.732134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.732134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.732435] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.732667] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.732898] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.907201] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.166355] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1159.166557] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 deletion is rescheduled due to dependency. [ 1159.166681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.410227] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.410388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.410458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.410747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.410851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.410894] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1159.422339] env[69255]: INFO networking_nsxv3.common.synchronization [req-2a13a1f4-359a-454d-8d9f-8fd23bb32a25 req-95508547-aa33-4260-b4bc-5b42275e914d service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1159.422533] env[69255]: INFO networking_nsxv3.common.synchronization [req-2a13a1f4-359a-454d-8d9f-8fd23bb32a25 req-95508547-aa33-4260-b4bc-5b42275e914d service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1159.422675] env[69255]: INFO networking_nsxv3.common.synchronization [req-2a13a1f4-359a-454d-8d9f-8fd23bb32a25 req-95508547-aa33-4260-b4bc-5b42275e914d service nova] Enqueued Resource ID: 7e85665e-95f7-4865-9666-421894f8afc7 with Priority: HIGHEST for action port [ 1159.423308] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1159.423453] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1159.423554] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e85665e-95f7-4865-9666-421894f8afc7 with Priority: HIGHEST for action port [ 1159.424314] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.424448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.424515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.424708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.424788] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.425700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.425821] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.426043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e85665e-95f7-4865-9666-421894f8afc7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.426148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.426206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.426387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.426514] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e85665e-95f7-4865-9666-421894f8afc7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.432390] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1159.432824] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 deletion is rescheduled due to dependency. [ 1159.432824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.433176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.433302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.433548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.433674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.433674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.433781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.433863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.433947] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.434051] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.435200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.435335] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.436523] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.436523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.436523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.436523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.436523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.436523] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.442695] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.442886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.442886] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.443070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.444052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.453013] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1159.928368] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.928368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.928368] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e85665e-95f7-4865-9666-421894f8afc7 with status ACTIVE [ 1159.928797] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.928797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.928797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.928933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.929087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.929307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.929438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.929519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.929939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.929939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.930052] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.930179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.930266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.930434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.930576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.930683] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e85665e-95f7-4865-9666-421894f8afc7 is going to be updated. [ 1159.937501] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.937674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.938041] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.938155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.938227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.938410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.938493] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.938666] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.938761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.938823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.939074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.939154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.939275] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be updated. [ 1159.955774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.956158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.956158] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.956325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.956396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.956537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e85665e-95f7-4865-9666-421894f8afc7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.967920] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.968169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.968220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.968397] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.968535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.977479] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1161.464639] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1161.465038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.465130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.465293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.465492] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.465630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.465698] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.465916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.466102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.466481] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.969068] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.988695] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1161.988880] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 deletion is rescheduled due to dependency. [ 1161.988982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.989200] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.989429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.989608] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.989729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.989784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.989934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.990031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.990143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.990309] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6627935d-0b5f-4439-bda8-bf197f556287 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.990406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.990465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.990609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.990745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.990838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.990898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.991040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.991133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.991247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.991313] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.471440] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.493628] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6627935d-0b5f-4439-bda8-bf197f556287: rpc.has_security_group_logging(os_id): False [ 1162.510648] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.510796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.510873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.511114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.511894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.512374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.512593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.512691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.512871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.512963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.513191] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.513296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.513361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.513510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.513588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.513775] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.513862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.513926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.514105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.514180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.514268] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be updated. [ 1162.574024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.574277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.574277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.574444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.574592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.587721] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: IN_PROGRESS for 2s [ 1162.973426] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.973597] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.973686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.973986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.973986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.974138] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1163.003016] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.003220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.003274] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.003459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.003624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.013466] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1163.156700] env[69255]: INFO networking_nsxv3.common.synchronization [None req-03fbb6c2-9ef9-4f39-9e78-a028a5bcbbaf tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_rules [ 1163.157323] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_rules [ 1163.157612] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.157736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.157806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.158157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.158241] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.230858] env[69255]: INFO networking_nsxv3.common.synchronization [None req-69774ade-de53-48be-98bb-5f87b1d32932 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_rules [ 1163.231376] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_rules [ 1163.231690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.231799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.681132] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.681558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.681558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.681638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.681709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.681819] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 already deleted. [ 1163.681914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.682097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.682286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.682381] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.206963] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.207145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.207218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.208197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.208197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.208197] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 already deleted. [ 1164.208197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.602301] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6627935d-0b5f-4439-bda8-bf197f556287 in Status: SUCCESS [ 1164.602494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.602756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.602929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.603014] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6627935d-0b5f-4439-bda8-bf197f556287',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.026330] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1165.026596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.026722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.027036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.027309] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.027374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.027932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.027932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.027932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.027932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.027932] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.125149] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.125346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.125346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.125593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.125593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.125662] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6627935d-0b5f-4439-bda8-bf197f556287 is going to be deleted. [ 1165.194675] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.194675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.194675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.194675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.194675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.194675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6627935d-0b5f-4439-bda8-bf197f556287" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.531042] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.531042] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.531042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.531533] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.531533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.531533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.531533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.531728] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.531728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.531804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.531954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.532048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.532141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.532263] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.034588] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1166.057317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.057555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.057604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.057810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.084946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.085330] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.085460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.085517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.085775] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.085876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.086104] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.086210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.086273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.086433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.086509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.086776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.086875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.086938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.087103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.087180] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.087268] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1166.154250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.154529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.154529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.154731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.154780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.186302] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1166.439033] env[69255]: INFO networking_nsxv3.common.synchronization [req-456c51e6-43a8-4cb5-adeb-86d1c70f18fd req-8ec401ae-df11-44f2-b697-3bc6e058716b tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1166.440302] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1166.440302] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.440302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.440302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.440683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.440683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.440811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.440811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.440964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.441056] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.441160] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.731882] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.732099] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.732228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.732507] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.732762] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.732973] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.736012] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.736345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.736548] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.736734] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1166.736938] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.737120] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.737242] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.737366] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1166.737511] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.737694] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.757135] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.757319] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1166.757467] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.757676] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.757994] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-ac123ecf-b40f-4813-8999-078f6e329204 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.758189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.758314] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.758660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.758806] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac123ecf-b40f-4813-8999-078f6e329204',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.945249] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.945480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.945480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.945675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.966859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.967150] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.967275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.967334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.967525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.967815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.967815] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1166.995192] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.995457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.995457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.995602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.995897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.005348] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1167.262118] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.262118] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.262576] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.262576] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.262645] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.262811] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port ac123ecf-b40f-4813-8999-078f6e329204 not found, creating... [ 1167.263097] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.263262] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.263384] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.263612] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.263764] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.264076] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.264240] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.264359] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.264572] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.264734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.264925] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: ac123ecf-b40f-4813-8999-078f6e329204 is going to be created. [ 1167.285331] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.285527] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.285643] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.285986] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.286250] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.286471] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.016666] env[69255]: INFO networking_nsxv3.common.synchronization [req-456c51e6-43a8-4cb5-adeb-86d1c70f18fd req-d72343c0-6501-4a12-84ee-22981fee2e28 service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1168.016880] env[69255]: INFO networking_nsxv3.common.synchronization [req-456c51e6-43a8-4cb5-adeb-86d1c70f18fd req-d72343c0-6501-4a12-84ee-22981fee2e28 service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1168.017058] env[69255]: INFO networking_nsxv3.common.synchronization [req-456c51e6-43a8-4cb5-adeb-86d1c70f18fd req-d72343c0-6501-4a12-84ee-22981fee2e28 service nova] Enqueued Resource ID: ac123ecf-b40f-4813-8999-078f6e329204 with Priority: HIGHEST for action port [ 1168.017639] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1168.017780] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1168.017897] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac123ecf-b40f-4813-8999-078f6e329204 with Priority: HIGHEST for action port [ 1168.018260] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.018394] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.018473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.018677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.018782] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.019792] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.019884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.020112] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac123ecf-b40f-4813-8999-078f6e329204 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.020207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.020355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.020453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.020526] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac123ecf-b40f-4813-8999-078f6e329204',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.202972] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1168.203221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.523021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac123ecf-b40f-4813-8999-078f6e329204 with status ACTIVE [ 1168.523496] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.523496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.523496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.523764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.523799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.524120] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.524221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.524293] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.524494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.524603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.524817] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.525438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.525438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.525438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.525438] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.525438] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac123ecf-b40f-4813-8999-078f6e329204 is going to be updated. [ 1168.526548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.526680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.562665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.562925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.563020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.563280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.563459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.563686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac123ecf-b40f-4813-8999-078f6e329204" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.660087] env[69255]: INFO networking_nsxv3.common.synchronization [req-3edb99b8-84c1-405d-9017-22cab3a9b968 req-f4d2d1d1-da51-4929-be5e-ce5dfc1d9ab2 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_members [ 1168.660680] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_members [ 1168.660986] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.661195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.661338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.661546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.661735] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.661839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.661904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.662117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.662208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.662316] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.968114] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.968114] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.968114] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.968114] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.968114] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.968447] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.968447] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.968537] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.968698] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.968909] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.969031] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.969146] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.969257] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.969368] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.969476] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.969609] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.987027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.987194] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1168.987341] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.987529] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.987839] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-e2ecbbde-1358-4310-a7dd-7b95de0402cf taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.988039] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.988150] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.988493] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.988638] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ecbbde-1358-4310-a7dd-7b95de0402cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.015975] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1169.015975] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b deletion is rescheduled due to dependency. [ 1169.016650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.016650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.016650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.016753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.016820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.016863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.017023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.017105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.018029] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.166024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.166024] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.166024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.166024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 already deleted. [ 1169.166522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.349779] env[69255]: INFO networking_nsxv3.common.synchronization [req-fd3d641f-32d7-402b-ac67-2f07129fc4d5 req-3cdd9836-664e-4f6d-bfe1-ee4923f4753b tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1169.350531] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1169.350689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.350794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.350860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.353563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.353843] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.353913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.353913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.354109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.354193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.354291] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.491227] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.491450] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.491579] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.491871] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.492396] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.492396] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port e2ecbbde-1358-4310-a7dd-7b95de0402cf not found, creating... [ 1169.492508] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.492603] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.492712] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.492925] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.493077] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.493359] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.493515] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.493660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.493882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.494030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.494175] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: e2ecbbde-1358-4310-a7dd-7b95de0402cf is going to be created. [ 1169.513043] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.513261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.513389] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.513719] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.513959] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.514202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.519466] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.855985] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.021647] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.271371] env[69255]: INFO networking_nsxv3.common.synchronization [req-3edb99b8-84c1-405d-9017-22cab3a9b968 req-c47ea3ce-895f-4db3-8a2f-5c6b5eb0ea78 service nova] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_rules [ 1170.271371] env[69255]: INFO networking_nsxv3.common.synchronization [req-3edb99b8-84c1-405d-9017-22cab3a9b968 req-c47ea3ce-895f-4db3-8a2f-5c6b5eb0ea78 service nova] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_members [ 1170.271371] env[69255]: INFO networking_nsxv3.common.synchronization [req-3edb99b8-84c1-405d-9017-22cab3a9b968 req-c47ea3ce-895f-4db3-8a2f-5c6b5eb0ea78 service nova] Enqueued Resource ID: e2ecbbde-1358-4310-a7dd-7b95de0402cf with Priority: HIGHEST for action port [ 1170.271371] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_rules [ 1170.271371] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_members [ 1170.271371] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ecbbde-1358-4310-a7dd-7b95de0402cf with Priority: HIGHEST for action port [ 1170.271371] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.271371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.271371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.271371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.271371] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.272951] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.273310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.273464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.273778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.275026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.275026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.275026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.275026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.275026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.275026] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.276069] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2ecbbde-1358-4310-a7dd-7b95de0402cf taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.276069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.276069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.276248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.276248] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ecbbde-1358-4310-a7dd-7b95de0402cf',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.359033] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.524099] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.524256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.524256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.524511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.524851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.525027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1170.552638] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.552856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.552856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.553221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.553414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.562176] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1170.778773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.778960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781788] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.781788] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2ecbbde-1358-4310-a7dd-7b95de0402cf with status ACTIVE [ 1170.781788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.781788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.781788] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.781788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.782353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.782353] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2ecbbde-1358-4310-a7dd-7b95de0402cf is going to be updated. [ 1170.806932] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.807105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.807165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.807351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.807484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.807663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2ecbbde-1358-4310-a7dd-7b95de0402cf" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.860787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.861211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.861211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.861312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.861460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.861525] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1170.905991] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.906208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.906271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.906463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.906610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.923920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1171.284209] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.786618] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.786815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.786871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.787070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.787159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.787261] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 is going to be created. [ 1171.810359] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.810511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.810586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.810782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.810950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.820217] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 in Status: UNINITIALIZED for 2s [ 1172.571671] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1172.571950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.572151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.572402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.572624] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.572773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.572867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.573065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.573155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.573255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.573352] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.937122] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1172.937945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.068426] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7b546298-6fc2-46c2-afa4-147b65b4dca7 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1173.069030] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1173.069344] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.069462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.069525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.070037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.070037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.070037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.073087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.073087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.073087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.073087] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.074893] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.075051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.572906] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.831269] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 in Status: SUCCESS [ 1173.831489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.831650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.831891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.832106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.832234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.832300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.832559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.832697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.832763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.832861] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.076340] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.335484] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.579435] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.579816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.579816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.579962] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.580094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.580207] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1174.609076] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.609275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.609275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.609439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.609584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.617686] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1174.838575] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af0234d8-5fb6-4559-8321-eb1748c80ba1: rpc.has_security_group_logging(os_id): False [ 1174.859607] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.859819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.859899] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.860228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.860379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.860761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.860924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.861052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.861318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.861515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.861696] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 is going to be created. [ 1174.944916] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.945245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.945375] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.945571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.945815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.961037] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 in Status: IN_PROGRESS for 2s [ 1175.279130] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.279530] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.279764] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.280202] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.280661] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.280944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.281282] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.281627] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.281862] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.282250] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.282469] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.282658] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.282828] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.282990] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.283147] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.283341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.313149] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.313408] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.313591] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.313878] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.314386] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-008944c4-e42c-4627-a29b-efa99bf5125f taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.314665] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.314890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.315443] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.315688] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('008944c4-e42c-4627-a29b-efa99bf5125f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.421560] env[69255]: INFO networking_nsxv3.common.synchronization [req-1214a5b4-e409-448a-a3f6-1d341c01be85 req-5d03a3af-2788-4bc2-a2b7-773a1489b783 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1175.421560] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1175.421560] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.421560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.421560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.421560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.421801] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.421801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.421801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.421935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.423297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.423297] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.818797] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.819270] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.819343] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.819737] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.820048] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.820315] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 008944c4-e42c-4627-a29b-efa99bf5125f not found, creating... [ 1175.820778] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.821048] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.821281] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.821549] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.821724] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.822078] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.822255] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.822404] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.822625] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.822773] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.822922] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 008944c4-e42c-4627-a29b-efa99bf5125f is going to be created. [ 1175.860993] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.861376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.861504] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.861893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.862193] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.862447] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.924668] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.427271] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.555189] env[69255]: INFO networking_nsxv3.common.synchronization [req-48427970-b1be-46d5-8b30-a6065f3b1de1 req-681b6e09-8b0c-49dc-9a25-c1b5544bcabf service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1176.555378] env[69255]: INFO networking_nsxv3.common.synchronization [req-48427970-b1be-46d5-8b30-a6065f3b1de1 req-681b6e09-8b0c-49dc-9a25-c1b5544bcabf service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1176.555524] env[69255]: INFO networking_nsxv3.common.synchronization [req-48427970-b1be-46d5-8b30-a6065f3b1de1 req-681b6e09-8b0c-49dc-9a25-c1b5544bcabf service nova] Enqueued Resource ID: 008944c4-e42c-4627-a29b-efa99bf5125f with Priority: HIGHEST for action port [ 1176.555863] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1176.556042] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1176.556170] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008944c4-e42c-4627-a29b-efa99bf5125f with Priority: HIGHEST for action port [ 1176.556829] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.556949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.557402] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.557502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.557765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-008944c4-e42c-4627-a29b-efa99bf5125f taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.557944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.558037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.558245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.558329] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('008944c4-e42c-4627-a29b-efa99bf5125f',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.627979] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1176.628182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.628313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.628534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.628724] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.628843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.628908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.629077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.629161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.629238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.629399] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.629480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.629538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.629678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.629853] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.629995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.630088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.630236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.630315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.630401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.630500] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.631352] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.631518] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.631663] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.631776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.631842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.631985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.632072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.632159] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.929774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.930315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.930315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.930315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.930609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.930609] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1176.959719] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.960024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.960024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.960658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.960658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.971468] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1176.972865] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 in Status: SUCCESS [ 1176.973089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.060763] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 008944c4-e42c-4627-a29b-efa99bf5125f with status ACTIVE [ 1177.061383] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.061383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.061383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.061383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.061383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.061660] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.061703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.061743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.062298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.062298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.062298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.062298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.062298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.062578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.062578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.062578] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 008944c4-e42c-4627-a29b-efa99bf5125f is going to be updated. [ 1177.084018] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.084222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.084276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.084532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.084603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.084781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-008944c4-e42c-4627-a29b-efa99bf5125f" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.135417] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.136524] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b: rpc.has_security_group_logging(os_id): False [ 1177.173146] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.173427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.173427] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.173636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.173759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.173963] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.174083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.174154] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.174321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.174406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.174633] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.174754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.174836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.174997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.175111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.175328] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.175431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.175491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.175697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.175791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.175921] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1177.303471] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.304666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.304666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.304666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.304889] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.331235] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1177.638672] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.141507] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.142035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.142035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.142125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.142277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.142358] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1178.181926] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.182187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.182187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.182451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.182659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.195272] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1178.982179] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1178.982447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.349760] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1179.350177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.350283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.350595] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.350706] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.853905] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.854086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.214920] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1180.215206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.215396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.215673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.215887] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.216029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.216118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.216307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.216400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.216497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.216605] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.722085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.722085] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.722085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.722764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.722764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.722764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.722764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.722963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.723201] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.723347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.723447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.723664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.723794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.723927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.724080] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.226421] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b: rpc.has_security_group_logging(os_id): False [ 1181.246988] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.246988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.246988] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.247194] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.247287] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.247481] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.247798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.247798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.247798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.247937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.249517] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.249517] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.249517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.249935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.249935] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1181.320590] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.320793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.320793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.321025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.321172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.337511] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1181.557767] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1181.557767] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1183.366237] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1183.366706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.187862] env[69255]: INFO networking_nsxv3.common.synchronization [req-f5462efb-ef18-4a03-8aff-d1e3ffb16cb9 req-e27eb204-869d-4e16-b93b-bec584d4c7fd tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1186.188486] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1186.188794] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.188969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.189358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.189648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.189902] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.190083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.190198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.190439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.190592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.190775] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.513466] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.513714] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.513847] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.514143] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.514411] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.514575] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.514698] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.514928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.515140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.515395] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.515615] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.515763] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.515903] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.516074] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.516217] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.516380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.539940] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.542029] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.542029] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.542029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.542029] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-a042e295-93c5-4446-97d3-8ed447e87d58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.542029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.542029] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.542439] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.542479] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a042e295-93c5-4446-97d3-8ed447e87d58',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.696065] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.044917] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.044917] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.044917] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.046065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.046065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.046065] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port a042e295-93c5-4446-97d3-8ed447e87d58 not found, creating... [ 1187.046065] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.046261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.046261] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.046493] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.046684] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.047056] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.047230] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.047348] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.047566] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.047701] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.048341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: a042e295-93c5-4446-97d3-8ed447e87d58 is going to be created. [ 1187.067239] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.067471] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.067691] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.067966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.068426] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.068577] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.198428] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.335347] env[69255]: INFO networking_nsxv3.common.synchronization [req-2796c37b-95b3-4897-8e23-76dc8c24e78a req-372a19c0-3550-4954-9fc0-64abcf5fe05d tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1187.336294] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1187.336660] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.336816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.336914] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.337167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.337484] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.337484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.337637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.337729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.337877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.338054] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.702550] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.702779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.702779] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.702995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.703133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.703201] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1187.734933] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.735111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.735162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.735381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.735586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.744768] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1187.754496] env[69255]: INFO networking_nsxv3.common.synchronization [req-f5462efb-ef18-4a03-8aff-d1e3ffb16cb9 req-25f2f554-8482-4926-8273-4026051dec19 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1187.754659] env[69255]: INFO networking_nsxv3.common.synchronization [req-f5462efb-ef18-4a03-8aff-d1e3ffb16cb9 req-25f2f554-8482-4926-8273-4026051dec19 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1187.754765] env[69255]: INFO networking_nsxv3.common.synchronization [req-f5462efb-ef18-4a03-8aff-d1e3ffb16cb9 req-25f2f554-8482-4926-8273-4026051dec19 service nova] Enqueued Resource ID: a042e295-93c5-4446-97d3-8ed447e87d58 with Priority: HIGHEST for action port [ 1187.755462] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1187.755574] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1187.755642] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a042e295-93c5-4446-97d3-8ed447e87d58 with Priority: HIGHEST for action port [ 1187.755940] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.756214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.756572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.756572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.756572] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.757472] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.757572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.757778] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a042e295-93c5-4446-97d3-8ed447e87d58 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.757891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.757979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.758142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.758225] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a042e295-93c5-4446-97d3-8ed447e87d58',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.841202] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.841202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.841202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.841202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.864144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.864425] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.864544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.864610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.864837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.864954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.865077] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1187.905668] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.905959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.905959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.906147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.906294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.916752] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1188.261173] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.261432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.261467] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a042e295-93c5-4446-97d3-8ed447e87d58 with status ACTIVE [ 1188.261669] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.261768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.261837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.262104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.262353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.262353] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.262465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.262558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.262648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.262730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.262897] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.262990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.263089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.263294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.263337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.263444] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a042e295-93c5-4446-97d3-8ed447e87d58 is going to be updated. [ 1188.289053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.289296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.289296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.289368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.289545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.289716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a042e295-93c5-4446-97d3-8ed447e87d58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.563416] env[69255]: INFO networking_nsxv3.common.synchronization [req-068e913b-d176-4a89-80d7-c2276ab3fb46 req-e482cb32-341c-4c15-af32-90394270fb7b tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1189.563996] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1189.564333] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.564465] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.564526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.565931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.565931] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.565931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.565931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.565931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.565931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.565931] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.754804] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1189.755073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.755251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.755474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.755742] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.755863] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.755929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.756160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.756300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.756434] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.928072] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1189.928072] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b deletion is rescheduled due to dependency. [ 1189.928072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.068547] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.260317] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.571603] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.762103] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.863442] env[69255]: INFO networking_nsxv3.common.synchronization [None req-86ad93f5-4dec-42be-ab2e-be3de2e24a5d tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1190.864043] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1190.866317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.866317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.073452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.073729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.073806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.074046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.074125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.074231] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1191.104265] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.104414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.104496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.104774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.105016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.116101] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1191.265805] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.265805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.265805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.265805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.265805] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.265805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1191.295621] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.295799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.295853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.296092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.296245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.306717] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1193.126665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1193.127091] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.127091] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.127289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.127468] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.127589] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.127655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.127824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.127912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.128018] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.316894] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1193.317176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.317346] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.317617] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.317819] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.317960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.318037] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.318192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.318281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.318358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.318451] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.630603] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.630824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.630824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.631080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.631177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.631375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.631472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.631537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.631729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.631810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.631901] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1193.659795] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.659995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.660050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.660252] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.660401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.669713] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1193.784957] env[69255]: INFO networking_nsxv3.common.synchronization [req-dcc19dc7-2e2d-41b3-aefe-daf385eb8273 req-e0a6bc15-5fa2-4662-870e-5d680d45c8c6 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_members [ 1193.785662] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGHEST for action security_group_members [ 1193.786216] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.786392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.786469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.786722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.786905] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.787024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.787102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.787276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.787381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.787480] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.821284] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.821452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.821520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.821709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.821875] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.822084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.822084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.822404] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.822500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.822591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.822814] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.822910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.822971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.824047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.824047] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.824047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.824047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.824047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.824047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.824047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.824047] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.290061] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.290456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.290456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.290701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.313076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.313336] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.313480] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.313552] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.313756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.313838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.313948] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 is going to be updated. [ 1194.327659] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1194.343648] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.343848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.343925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.344167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.344300] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.344463] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.344565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.344630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.344784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.344864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.345080] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.345172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.345233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.345371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.345443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.345690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.345784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.345851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.345990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.346074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.346163] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1194.347911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.348039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.348118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.348263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.348395] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.357285] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 in Status: IN_PROGRESS for 2s [ 1194.408267] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.408546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.408546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.408740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.408740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.433078] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1195.290545] env[69255]: INFO networking_nsxv3.common.synchronization [req-7d18ac57-579f-4680-ba77-17258d8166ba req-0956f08e-a773-4223-bd19-e03d44899b03 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_members [ 1195.291339] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGHEST for action security_group_members [ 1195.291676] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.291804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.291873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.292094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.292253] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.292354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.292419] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.292568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.292653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.292751] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.680746] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1195.680902] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b deletion is rescheduled due to dependency. [ 1195.681031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.795522] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.795709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.795761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.795989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.818023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.818371] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.818525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.818619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.818850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.818944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.819087] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 is going to be updated. [ 1195.851620] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.851871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.851981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.852354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.852494] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.863641] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6428cece-54ff-401f-affd-cd4584d1d303 in Status: IN_PROGRESS for 2s [ 1196.062516] env[69255]: INFO networking_nsxv3.common.synchronization [req-d62dc903-b28a-4979-8017-954f58f80d23 req-2efc98b3-456b-48eb-a624-5be4e6d17f2f tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1196.063189] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1196.063725] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.063860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.063920] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.064208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.064291] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.064372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.064476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.064575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.065092] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.065092] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.371148] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 in Status: SUCCESS [ 1196.371148] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 deletion is rescheduled due to dependency. [ 1196.371148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.450786] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1196.451259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.519457] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.519759] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.519943] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.520247] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.520578] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.520752] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.520914] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.521107] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.521264] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.521529] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.521669] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.521784] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.521901] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.522030] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.522144] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.522280] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.541688] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.541970] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1196.542109] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.542225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-233" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.542596] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-cc89906a-e2dd-4fb4-945b-1f6d386bb197 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.542834] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.542967] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.543392] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.543554] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc89906a-e2dd-4fb4-945b-1f6d386bb197',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.567163] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.567350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.567350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.567565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.567690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.567965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.568116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.568187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.568353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.568436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.568528] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1196.594604] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.594770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.594816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.595017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.595164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.606024] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1197.046911] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.047163] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.047297] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.047583] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.047735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.047932] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port cc89906a-e2dd-4fb4-945b-1f6d386bb197 not found, creating... [ 1197.048222] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.048385] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.048541] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.048778] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.048917] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.049236] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.049392] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.049511] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.049722] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.049872] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.050087] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: cc89906a-e2dd-4fb4-945b-1f6d386bb197 is going to be created. [ 1197.071482] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.071710] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.071808] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.072175] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.072421] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.073030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.876189] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6428cece-54ff-401f-affd-cd4584d1d303 in Status: SUCCESS [ 1197.876481] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 deletion is rescheduled due to dependency. [ 1197.876481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.277217] env[69255]: INFO networking_nsxv3.common.synchronization [req-d62dc903-b28a-4979-8017-954f58f80d23 req-311c6a06-a4be-4c0b-ba08-6e8a39d9b407 service nova] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 1198.277416] env[69255]: INFO networking_nsxv3.common.synchronization [req-d62dc903-b28a-4979-8017-954f58f80d23 req-311c6a06-a4be-4c0b-ba08-6e8a39d9b407 service nova] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1198.277594] env[69255]: INFO networking_nsxv3.common.synchronization [req-d62dc903-b28a-4979-8017-954f58f80d23 req-311c6a06-a4be-4c0b-ba08-6e8a39d9b407 service nova] Enqueued Resource ID: cc89906a-e2dd-4fb4-945b-1f6d386bb197 with Priority: HIGHEST for action port [ 1198.277860] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_rules [ 1198.278041] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1198.278156] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc89906a-e2dd-4fb4-945b-1f6d386bb197 with Priority: HIGHEST for action port [ 1198.278726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.278857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.278925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.279330] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.279457] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.280372] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.280537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.280821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc89906a-e2dd-4fb4-945b-1f6d386bb197 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.280978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.281106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.281323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.281449] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc89906a-e2dd-4fb4-945b-1f6d386bb197',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.615540] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1198.615716] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b deletion is rescheduled due to dependency. [ 1198.615833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.616021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.616231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.616409] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.616543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.616602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.616737] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.616819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.616914] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.784048] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.784216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.784377] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc89906a-e2dd-4fb4-945b-1f6d386bb197 with status ACTIVE [ 1198.784696] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.784868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.784997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.785353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.785505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.785810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.786234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.786234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.786658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.786848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.787171] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.787351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.787478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.787722] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.787845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.788019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc89906a-e2dd-4fb4-945b-1f6d386bb197 is going to be updated. [ 1198.810716] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.810938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.810938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.811185] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.811337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.811495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc89906a-e2dd-4fb4-945b-1f6d386bb197" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.118851] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.620999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.767558] env[69255]: INFO networking_nsxv3.common.synchronization [req-c4900cf0-4065-44a8-86cc-dcf45240c9cf req-cfd038ac-dc63-424f-a831-efefb226ad21 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1199.767613] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1199.767959] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.768093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.768161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.768351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.768530] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.768636] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.768696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.768845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.768929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.769027] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.123890] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.124268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.124268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.124393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.124457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.124560] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1200.153235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.153421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.153421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.153646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.153806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.162008] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1200.270895] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.556167] env[69255]: INFO networking_nsxv3.common.synchronization [None req-912ec4d7-04cd-487c-a717-a8d470b5c823 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1200.556778] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1200.557259] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.557390] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.557467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.557720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.557933] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.638256] env[69255]: INFO networking_nsxv3.common.synchronization [None req-7463e4b2-1a42-4a3c-a6a5-792e4cf00bb7 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1200.638256] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1200.638256] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.638256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.772826] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.077701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.077994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.077994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.078163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.078255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.078353] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb already deleted. [ 1201.078435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.078579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.078742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.078826] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.275154] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.275487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.275487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.275759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.275861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.275970] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1201.303423] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.303609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.303699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.303929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.304144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.314341] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1201.600100] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.600697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.600697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.600697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.600697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.600697] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb already deleted. [ 1201.600934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.171025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1202.171256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.171423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.171649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.171840] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.171955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.172025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.172199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.172276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.172360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.172450] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.225667] env[69255]: INFO networking_nsxv3.common.synchronization [None req-d630a8d5-8f40-48b1-93a2-3423519b836b tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_rules [ 1202.226199] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_rules [ 1202.226513] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.226647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.226828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.227130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.227214] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.302272] env[69255]: INFO networking_nsxv3.common.synchronization [None req-052a6fa2-adf4-450e-b5fc-444b3c128e70 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_rules [ 1202.302864] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_rules [ 1202.303365] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.303785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.674444] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.747491] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.747649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.747695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.747880] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.747969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.748079] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 already deleted. [ 1202.748163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.749049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.749233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.749323] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.176463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97be36bb-9aa7-4ca4-9b9b-f2f13467259b: rpc.has_security_group_logging(os_id): False [ 1203.193200] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.193362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.193439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.193725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.193825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.194348] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.194348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.194348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.194523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.194523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.194588] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1203.253953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.254168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.254168] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.254321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.254475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.270374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.270583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.270583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.270774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.270895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.271046] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 already deleted. [ 1203.271046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.271747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1203.340929] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1203.341336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.284832] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1205.285204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.487664] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.487979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.487979] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.488173] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.488715] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.488715] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.488855] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.488980] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.489149] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.489384] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.489478] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.489591] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.489830] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.489830] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1206.489930] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.490098] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.510269] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.510375] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1206.510528] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.510723] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.511042] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-cadf202c-1b9e-4c0e-92c8-53217aa146a8 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.511221] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.511345] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.511612] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.511756] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cadf202c-1b9e-4c0e-92c8-53217aa146a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.013711] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.013994] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.014066] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.014420] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.014580] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.014878] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.015658] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.015658] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.015658] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.015658] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.016184] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.016184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.016294] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.016434] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.016580] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.016728] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 is going to be updated. [ 1207.038337] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.038565] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.038679] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.039059] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.039263] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.039426] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.304178] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.304287] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1207.746247] env[69255]: INFO networking_nsxv3.common.synchronization [req-4c9a1a16-b01a-4b5d-ad6d-d4e7a577c447 req-1883e068-24d7-48b7-b4c4-4e7148e3d270 service nova] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1207.746247] env[69255]: INFO networking_nsxv3.common.synchronization [req-4c9a1a16-b01a-4b5d-ad6d-d4e7a577c447 req-1883e068-24d7-48b7-b4c4-4e7148e3d270 service nova] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1207.746247] env[69255]: INFO networking_nsxv3.common.synchronization [req-4c9a1a16-b01a-4b5d-ad6d-d4e7a577c447 req-1883e068-24d7-48b7-b4c4-4e7148e3d270 service nova] Enqueued Resource ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 with Priority: HIGHEST for action port [ 1207.746247] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_rules [ 1207.746898] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1207.747200] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 with Priority: HIGHEST for action port [ 1207.753283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.753283] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.753283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.753283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.753283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.753283] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.755063] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-cadf202c-1b9e-4c0e-92c8-53217aa146a8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.755179] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.755251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.755402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.755492] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cadf202c-1b9e-4c0e-92c8-53217aa146a8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.256884] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.257137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.257249] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.258627] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cadf202c-1b9e-4c0e-92c8-53217aa146a8 with status ACTIVE [ 1208.258627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.258627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.258627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.258882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.258882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.258946] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.259058] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.259117] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.263027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.263027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.263027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.263027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.263027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.263027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.263027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.263027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cadf202c-1b9e-4c0e-92c8-53217aa146a8 is going to be updated. [ 1208.285151] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.285436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.285525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.285734] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.285868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.286067] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cadf202c-1b9e-4c0e-92c8-53217aa146a8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.762321] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.208474] env[69255]: INFO networking_nsxv3.common.synchronization [req-5d5d3f2a-bf3c-470b-9b3d-947e5fb7cdec req-9fcd6091-c221-4420-9f07-78c4e8c7f034 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1209.208710] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1209.209168] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.209339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.209445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.209778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.213020] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.213020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.213020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.213020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.213020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.213020] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.264589] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.264758] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.264832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.265062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.265157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.265263] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a is going to be updated. [ 1209.295374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.295712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.295712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.295934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.296372] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.306764] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: IN_PROGRESS for 2s [ 1209.549720] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.549909] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.550084] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.550326] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.550590] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.550746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.550869] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.551099] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.551376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.551628] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.551760] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.551879] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.552072] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.552211] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.552332] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.552486] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.572308] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.572599] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.572754] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.572938] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.573268] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-adc97048-2011-4c84-ae8f-50fc8b2179f7 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.573446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.573574] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.574014] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.574213] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc97048-2011-4c84-ae8f-50fc8b2179f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.713740] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.713740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.713740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.713740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.713740] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.713955] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.714074] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.714144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.714350] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.714435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.714572] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb already deleted. [ 1209.714615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.076305] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.076904] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.076904] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.077233] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.077469] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.077704] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port adc97048-2011-4c84-ae8f-50fc8b2179f7 not found, creating... [ 1210.078070] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.078319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.078518] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.078811] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.079037] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.079409] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.079648] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.079845] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.080140] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.080353] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.080570] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: adc97048-2011-4c84-ae8f-50fc8b2179f7 is going to be created. [ 1210.101518] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.101749] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.101910] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.102288] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.102526] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.102760] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.786763] env[69255]: INFO networking_nsxv3.common.synchronization [req-5d5d3f2a-bf3c-470b-9b3d-947e5fb7cdec req-7d5693a9-eaa8-4eff-a010-f4e663292c86 service nova] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1210.786962] env[69255]: INFO networking_nsxv3.common.synchronization [req-5d5d3f2a-bf3c-470b-9b3d-947e5fb7cdec req-7d5693a9-eaa8-4eff-a010-f4e663292c86 service nova] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1210.787124] env[69255]: INFO networking_nsxv3.common.synchronization [req-5d5d3f2a-bf3c-470b-9b3d-947e5fb7cdec req-7d5693a9-eaa8-4eff-a010-f4e663292c86 service nova] Enqueued Resource ID: adc97048-2011-4c84-ae8f-50fc8b2179f7 with Priority: HIGHEST for action port [ 1210.787357] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1210.787493] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1210.787610] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adc97048-2011-4c84-ae8f-50fc8b2179f7 with Priority: HIGHEST for action port [ 1210.788266] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.788443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.788565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.788916] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.789138] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.790108] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.790275] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.790385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.790602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.790825] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.792934] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.792934] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-adc97048-2011-4c84-ae8f-50fc8b2179f7 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.792934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.792934] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc97048-2011-4c84-ae8f-50fc8b2179f7',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.294827] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adc97048-2011-4c84-ae8f-50fc8b2179f7 with status ACTIVE [ 1211.295184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.295569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.295569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.295677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.295780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.296015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.296160] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.296244] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.296432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.296538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.296773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.296897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.296981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.297175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.297273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.297383] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adc97048-2011-4c84-ae8f-50fc8b2179f7 is going to be updated. [ 1211.298889] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.299030] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.299285] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.315877] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: SUCCESS [ 1211.316230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.316348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.316455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.316642] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.316765] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.316835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.316981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.317075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.317161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.317253] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.320948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.321045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.321119] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.321286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.321416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.321563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adc97048-2011-4c84-ae8f-50fc8b2179f7" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.451376] env[69255]: INFO networking_nsxv3.common.synchronization [req-b1a621a8-fc2b-49af-b1ca-d62fd3eb03b3 req-60df4536-ad95-4fcb-a8f9-fa24bf3d5244 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_members [ 1211.451824] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_members [ 1211.452205] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.452660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.452736] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.453009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.453175] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.453281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.453356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.453548] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.453630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.453723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.769908] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.769908] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.770112] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.770369] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.770720] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.770889] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.771017] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.771340] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.771513] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.771724] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.772095] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.772289] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.772502] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.772712] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.772879] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.773069] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.793751] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.793960] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1211.794119] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.794310] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-186" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.794619] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.794794] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.794933] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.795310] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.795499] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d661a5-f2ae-41cf-a6c5-f0616fc1c989',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.805036] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.819496] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.956246] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.956333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.956431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.956681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.956810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.957144] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.957319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.957441] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.957700] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.957851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.958009] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 already deleted. [ 1211.958162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.298314] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.298735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.298735] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.299038] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.299221] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.299412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 38d661a5-f2ae-41cf-a6c5-f0616fc1c989 not found, creating... [ 1212.299679] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.299848] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.299989] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.300308] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.300493] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.300806] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.300991] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.301124] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.301371] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.301535] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.301710] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 38d661a5-f2ae-41cf-a6c5-f0616fc1c989 is going to be created. [ 1212.303400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.303516] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.303575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.303729] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.303808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.303896] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be created. [ 1212.322372] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.322643] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.322794] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.323183] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.323498] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.323904] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.324712] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1d269b6-2543-4ac4-ba27-81ea5467b07a: rpc.has_security_group_logging(os_id): False [ 1212.326796] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.327443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.327603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.327808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.327996] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.337970] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: UNINITIALIZED for 2s [ 1212.345935] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.346148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.346196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.346434] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.365793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.366164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.366306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.366410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.366669] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.366769] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.366864] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a is going to be updated. [ 1212.456098] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.456337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.456337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.456693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.456693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.478285] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: IN_PROGRESS for 2s [ 1213.033560] env[69255]: INFO networking_nsxv3.common.synchronization [req-b1a621a8-fc2b-49af-b1ca-d62fd3eb03b3 req-5727d9d2-23c8-4a26-abbe-d0d24516369a service nova] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_rules [ 1213.033560] env[69255]: INFO networking_nsxv3.common.synchronization [req-b1a621a8-fc2b-49af-b1ca-d62fd3eb03b3 req-5727d9d2-23c8-4a26-abbe-d0d24516369a service nova] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_members [ 1213.033560] env[69255]: INFO networking_nsxv3.common.synchronization [req-b1a621a8-fc2b-49af-b1ca-d62fd3eb03b3 req-5727d9d2-23c8-4a26-abbe-d0d24516369a service nova] Enqueued Resource ID: 38d661a5-f2ae-41cf-a6c5-f0616fc1c989 with Priority: HIGHEST for action port [ 1213.033785] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_rules [ 1213.033911] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_members [ 1213.034017] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d661a5-f2ae-41cf-a6c5-f0616fc1c989 with Priority: HIGHEST for action port [ 1213.034571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.034704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.034767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.034969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.035061] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.036248] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.036364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.036429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.036658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.036801] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.036900] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.036976] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.037149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.037220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.037332] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.038090] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.038215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.038282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.038445] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.038502] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d661a5-f2ae-41cf-a6c5-f0616fc1c989',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.539917] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.541139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.541306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.541412] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38d661a5-f2ae-41cf-a6c5-f0616fc1c989 with status ACTIVE [ 1213.541572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.541676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.541735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.543016] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.543016] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.543016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.543762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.543762] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38d661a5-f2ae-41cf-a6c5-f0616fc1c989 is going to be updated. [ 1213.568053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.568053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.568053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.568356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.568389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.568573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38d661a5-f2ae-41cf-a6c5-f0616fc1c989" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.733530] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa085ca7-1d27-4996-9979-b899fb0b7594 req-ac758ad7-5b34-4426-bf4a-9c98351d8f93 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1213.734208] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1213.734532] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.734676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.734718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.734895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.735056] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.735193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.735282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.735497] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.735607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.735728] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.045849] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.061995] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.062181] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.062359] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.062708] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.063089] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.063310] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.063515] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.063817] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.064027] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.064303] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.064637] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.064637] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.064738] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.064850] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.064988] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.065173] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.084556] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.084804] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.085014] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.085213] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-232" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.085559] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.085741] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.085880] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.086284] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.086434] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81e20a6a-7eb4-43d3-a297-42d116a5cf0e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.238318] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.348266] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1214.348481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.349877] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.349877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.349877] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.494214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: SUCCESS [ 1214.494502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.549346] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.549756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.549756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.549756] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.549866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.549924] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 is going to be created. [ 1214.578040] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.578318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.578318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.578473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.578639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.589926] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.590160] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.590311] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.590609] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.590769] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.590982] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 81e20a6a-7eb4-43d3-a297-42d116a5cf0e not found, creating... [ 1214.591336] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.591532] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.591759] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.592065] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.592230] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.592534] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.592696] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.592816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.593049] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.593191] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.593355] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 81e20a6a-7eb4-43d3-a297-42d116a5cf0e is going to be created. [ 1214.594735] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 in Status: UNINITIALIZED for 2s [ 1214.619515] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.619840] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.620076] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.620557] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.620983] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.621414] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.741085] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.853139] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.246211] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.246211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.246211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.246211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.246211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.246211] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1215.288026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.288026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.288026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.288026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.288026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.302022] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1215.327266] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa085ca7-1d27-4996-9979-b899fb0b7594 req-9dbf89e6-fcbd-40ce-a8fc-6ec97e1352a7 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1215.327266] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa085ca7-1d27-4996-9979-b899fb0b7594 req-9dbf89e6-fcbd-40ce-a8fc-6ec97e1352a7 service nova] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1215.327266] env[69255]: INFO networking_nsxv3.common.synchronization [req-fa085ca7-1d27-4996-9979-b899fb0b7594 req-9dbf89e6-fcbd-40ce-a8fc-6ec97e1352a7 service nova] Enqueued Resource ID: 81e20a6a-7eb4-43d3-a297-42d116a5cf0e with Priority: HIGHEST for action port [ 1215.327266] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_rules [ 1215.327266] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1215.327266] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81e20a6a-7eb4-43d3-a297-42d116a5cf0e with Priority: HIGHEST for action port [ 1215.327779] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.328108] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.328298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.328618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.329491] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.329993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.330272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.330882] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.331214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.331851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.331851] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.331851] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81e20a6a-7eb4-43d3-a297-42d116a5cf0e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.355605] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e357209-1eed-448c-9ee5-ec4e2d16d2cb: rpc.has_security_group_logging(os_id): False [ 1215.382627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.382907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.382907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.383313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.383313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.383575] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.383680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.383739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.383927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.383984] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.384115] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be created. [ 1215.464544] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.464719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.464804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.469027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.469027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.483419] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: IN_PROGRESS for 2s [ 1215.834873] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.835334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.835334] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81e20a6a-7eb4-43d3-a297-42d116a5cf0e with status ACTIVE [ 1215.835439] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.835599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.835599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.835820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.836025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.836137] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.836257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.836319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.836479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.836575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.836795] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.836942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.837021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.837141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.837218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.837305] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81e20a6a-7eb4-43d3-a297-42d116a5cf0e is going to be updated. [ 1215.861761] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.861761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.861761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.861985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.862121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.862281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81e20a6a-7eb4-43d3-a297-42d116a5cf0e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.607557] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 in Status: SUCCESS [ 1216.608956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.608956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.608956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.608956] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.608956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.608956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.608956] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.609309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.609309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.609367] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.112593] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.315047] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1217.315047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.315047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.315047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.315316] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.315316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.315477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.315557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.315641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.315737] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.498225] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1217.498660] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.616999] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fa255da-5c61-407a-a6c5-685ff96ea223: rpc.has_security_group_logging(os_id): False [ 1217.640541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.640541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.640541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.640541] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 is going to be created. [ 1217.708267] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.709221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.709221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.709221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.709221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.721594] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 in Status: IN_PROGRESS for 2s [ 1217.818321] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.320892] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.823992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.824234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.824234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.824534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.824688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.824757] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1218.865284] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.865481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.865578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.865778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.865931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.880516] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1219.736202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 in Status: SUCCESS [ 1219.736797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.327658] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.327833] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1220.891020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1220.891315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.891463] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.891705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.891917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.892078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.892169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.893045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.893045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.893045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.893045] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.396944] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.396944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.396944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.397225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.397279] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.397362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.397424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.397801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.397801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.397982] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.399132] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.399132] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.399132] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.399577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.399577] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.901463] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1200176c-af01-46da-8315-622c4d3250d8: rpc.has_security_group_logging(os_id): False [ 1221.919018] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.919166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.919241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.919461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.919556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.919765] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.919847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.919892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.920049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.920125] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.920321] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.920417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.920478] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.920612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.920682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.920859] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.920949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.921015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.921220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.921304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.921415] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1221.985449] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.985653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.985723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.985949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.986140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.006063] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1224.029777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1224.030174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.328883] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.329303] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.304213] env[69255]: INFO networking_nsxv3.common.synchronization [req-ccf8453a-cdac-4426-bae4-9657dd58a9e1 req-4f77dbdc-56c2-44a6-b906-2e29fd79b8fe tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1226.304806] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1226.305155] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.305278] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.305347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.305633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.305794] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.305890] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.305948] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.307855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.307855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.307855] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.594783] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.595213] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.595213] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.595294] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.595586] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.595744] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.595856] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.596093] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.596259] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.596456] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.596575] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.596706] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.596819] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.596933] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.597054] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.597181] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.617485] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.617652] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.617793] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.617981] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.618309] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-e3f67bd6-653e-4b05-8184-06715052df26 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.618484] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.618610] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.618957] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.619176] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f67bd6-653e-4b05-8184-06715052df26',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.810137] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.121117] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.124148] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port e3f67bd6-653e-4b05-8184-06715052df26 not found, creating... [ 1227.124148] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.124148] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.124460] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.124460] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.130189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.130189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.130189] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.130189] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: e3f67bd6-653e-4b05-8184-06715052df26 is going to be created. [ 1227.150954] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.150954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.150954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.150954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.150954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.150954] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.311816] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.814380] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.814774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.814774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.814955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.815080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.815198] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be updated. [ 1227.846311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.846515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.846515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.847598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.847598] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.857499] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: IN_PROGRESS for 2s [ 1227.866016] env[69255]: INFO networking_nsxv3.common.synchronization [req-ccf8453a-cdac-4426-bae4-9657dd58a9e1 req-e3bffda7-1882-4321-bf47-fd7760595f47 service nova] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1227.866213] env[69255]: INFO networking_nsxv3.common.synchronization [req-ccf8453a-cdac-4426-bae4-9657dd58a9e1 req-e3bffda7-1882-4321-bf47-fd7760595f47 service nova] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1227.866358] env[69255]: INFO networking_nsxv3.common.synchronization [req-ccf8453a-cdac-4426-bae4-9657dd58a9e1 req-e3bffda7-1882-4321-bf47-fd7760595f47 service nova] Enqueued Resource ID: e3f67bd6-653e-4b05-8184-06715052df26 with Priority: HIGHEST for action port [ 1227.866923] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_rules [ 1227.867086] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1227.867190] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3f67bd6-653e-4b05-8184-06715052df26 with Priority: HIGHEST for action port [ 1227.867472] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.867594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.867661] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.867893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.867982] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.869768] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.869893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.870195] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3f67bd6-653e-4b05-8184-06715052df26 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.870195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.870329] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.870425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.870505] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f67bd6-653e-4b05-8184-06715052df26',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.373109] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.373331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.373568] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3f67bd6-653e-4b05-8184-06715052df26 with status ACTIVE [ 1228.373807] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.373944] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.374063] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.374273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.374384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.374571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.374659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.374759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.374883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.374978] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.375200] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.375296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.375359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.375596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.375670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.375772] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3f67bd6-653e-4b05-8184-06715052df26 is going to be updated. [ 1228.400834] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.401082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.401082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.401311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.401483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.401650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3f67bd6-653e-4b05-8184-06715052df26" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.871668] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1229.872040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.872172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.872439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.872665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.872823] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.872925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.873162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.873261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.873400] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.375864] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.879723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.383074] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.383268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.383323] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.383531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.383622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.383727] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be updated. [ 1231.412844] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.413048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.413151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.413336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.413580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.422948] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: IN_PROGRESS for 2s [ 1231.449190] env[69255]: INFO networking_nsxv3.common.synchronization [req-7cd73fda-2283-423a-b035-97d85ce34d1a req-384e75ed-fa86-43aa-83c4-52fb13b77e4e tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1231.449730] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1231.450068] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.450192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.450264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.450460] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.450615] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.450711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.450770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.451291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.451291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.451291] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.953691] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.456527] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.959665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.961303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.961303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.961303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.961303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.961513] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1232.992503] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.992684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.992757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.992971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.993133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.001745] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1233.010185] env[69255]: INFO networking_nsxv3.common.synchronization [req-fb351efa-c4e7-4578-abe5-ce79a3b113f5 req-17d66ab2-abe1-44e4-87e3-b420342e128d tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_members [ 1233.010716] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGHEST for action security_group_members [ 1233.011027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.011148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.011217] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.011410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.011559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.011653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.011715] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.011857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.011938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.012039] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.434590] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1233.434799] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.434977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.435224] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.435485] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.435634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.435697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.435866] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.435951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.436051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.436146] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.513901] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.514157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.514157] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.514318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.536588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.536836] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.536959] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.537061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.537292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.537378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.537476] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 is going to be updated. [ 1233.564821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.565124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.565124] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.565253] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.565398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.574962] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 in Status: IN_PROGRESS for 2s [ 1233.938482] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.441232] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e357209-1eed-448c-9ee5-ec4e2d16d2cb: rpc.has_security_group_logging(os_id): False [ 1234.461764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.461764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.462031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.462078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.462149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.462415] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.462525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.462568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.462725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.462794] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.462884] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be updated. [ 1234.518342] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.518593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.518593] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.518770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.518891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.533615] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: IN_PROGRESS for 2s [ 1235.013048] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1235.013048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.585832] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 in Status: SUCCESS [ 1235.586320] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 deletion is rescheduled due to dependency. [ 1235.586320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.553500] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1236.553705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.439840] env[69255]: INFO networking_nsxv3.common.synchronization [None req-b227ddbd-3fd9-49b8-83d9-60ff60b31838 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1237.441206] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1237.441206] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.441206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.441206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.441206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.441206] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.441625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.441625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.441625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.441625] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.441742] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.943426] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.943699] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.943811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.944060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.944173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.944291] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.944389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.944461] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.944604] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.944685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.944773] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1237.973026] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.973172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.973258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.973496] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.973662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.982870] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1238.016504] env[69255]: INFO networking_nsxv3.common.synchronization [req-7e8bdf21-2e5a-4020-bf83-760f2d21f246 req-e20fd4de-46b5-4962-8217-1bb0ac187381 tempest-ServersTestJSON-1391011431 tempest-ServersTestJSON-1391011431-project-member] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1238.019038] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGHEST for action security_group_members [ 1238.019038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.019038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.019038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.019552] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.167115] env[69255]: INFO networking_nsxv3.common.synchronization [None req-aea816fa-a52c-4254-86a5-16024851c89d tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_rules [ 1238.167686] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_rules [ 1238.168080] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.168232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.168388] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.168594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.168694] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.277711] env[69255]: INFO networking_nsxv3.common.synchronization [None req-e71f5244-cb4b-46a7-8b73-f34bfba174db tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_rules [ 1238.279615] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_rules [ 1238.279615] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.279615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.522070] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.522402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.522402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.522581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.522681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.522893] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.522997] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.523077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.523230] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.523311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.523407] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be updated. [ 1238.558265] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.558490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.558628] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.558923] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.559162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.568248] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: IN_PROGRESS for 2s [ 1238.691847] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.692170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.692213] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.696021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.696021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.696021] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29974051-cea6-4575-91c9-c21beee8c912 already deleted. [ 1238.696021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.696021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.696021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.696021] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.219660] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.219865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.219865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.220089] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.220198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.220301] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29974051-cea6-4575-91c9-c21beee8c912 already deleted. [ 1239.220383] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.020484] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1240.020801] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b deletion is rescheduled due to dependency. [ 1240.020801] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.579054] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1200176c-af01-46da-8315-622c4d3250d8 in Status: SUCCESS [ 1240.579245] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1200176c-af01-46da-8315-622c4d3250d8 deletion is rescheduled due to dependency. [ 1240.579337] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.278965] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1243.279476] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1244.326515] env[69255]: INFO networking_nsxv3.common.synchronization [req-9cff0fd5-d5f9-4e7a-9d54-9d7188067b40 req-bca597ee-5da7-4f00-b63b-c8f0bcf93918 tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_members [ 1244.327053] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_members [ 1244.327353] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.327476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.327544] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.327825] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.328009] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.328467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.328541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.328742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.328793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.328880] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.606020] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.606020] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.606020] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.606020] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.606020] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.606020] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.606020] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.606020] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.606718] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.607198] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.608311] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.608311] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.608311] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.608311] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1244.608504] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.608770] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.631029] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.631029] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1244.631265] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.631505] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-19" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.631911] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-a0963ad4-6076-469b-bf64-fcb473d2006a taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.632165] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.632329] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.632935] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.632935] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0963ad4-6076-469b-bf64-fcb473d2006a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.832588] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.832761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.832844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.833081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.833174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.833380] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.833511] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.833580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.833741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.833822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.833908] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29974051-cea6-4575-91c9-c21beee8c912 already deleted. [ 1244.833991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.135654] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.135883] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.135999] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.136314] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.136495] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.136675] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port a0963ad4-6076-469b-bf64-fcb473d2006a not found, creating... [ 1245.136945] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.137125] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.137260] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.137499] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.137649] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.137945] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.138116] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.138239] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.138457] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.138613] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.138773] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: a0963ad4-6076-469b-bf64-fcb473d2006a is going to be created. [ 1245.160525] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.160759] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.160860] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.161182] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.161422] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.161655] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.836413] env[69255]: INFO networking_nsxv3.common.synchronization [req-9cff0fd5-d5f9-4e7a-9d54-9d7188067b40 req-ac37b22a-3276-4784-8c34-aeaeeb8c69f0 service nova] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_rules [ 1245.836709] env[69255]: INFO networking_nsxv3.common.synchronization [req-9cff0fd5-d5f9-4e7a-9d54-9d7188067b40 req-ac37b22a-3276-4784-8c34-aeaeeb8c69f0 service nova] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_members [ 1245.836901] env[69255]: INFO networking_nsxv3.common.synchronization [req-9cff0fd5-d5f9-4e7a-9d54-9d7188067b40 req-ac37b22a-3276-4784-8c34-aeaeeb8c69f0 service nova] Enqueued Resource ID: a0963ad4-6076-469b-bf64-fcb473d2006a with Priority: HIGHEST for action port [ 1245.837310] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_rules [ 1245.837451] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_members [ 1245.837553] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0963ad4-6076-469b-bf64-fcb473d2006a with Priority: HIGHEST for action port [ 1245.837911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.838087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.838144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.838306] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.838381] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.840140] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.840140] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.840140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.840429] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.840900] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0963ad4-6076-469b-bf64-fcb473d2006a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.841009] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.841239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.841239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.841315] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0963ad4-6076-469b-bf64-fcb473d2006a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.343505] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.343505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.343745] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.345220] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0963ad4-6076-469b-bf64-fcb473d2006a with status ACTIVE [ 1246.345489] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.345656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.345727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.345931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.346031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.346206] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.346305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.346368] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.346522] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.346621] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.346801] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.346898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.346974] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.347336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.347384] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.347469] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0963ad4-6076-469b-bf64-fcb473d2006a is going to be updated. [ 1246.369131] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.369341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.369341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.369525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.369663] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.369819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0963ad4-6076-469b-bf64-fcb473d2006a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.849563] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.353041] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.353041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.353041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.353041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.353041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.353041] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29974051-cea6-4575-91c9-c21beee8c912 is going to be created. [ 1247.374769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.374991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.374991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.375199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.375361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.385027] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: UNINITIALIZED for 2s [ 1249.395720] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: SUCCESS [ 1249.396105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.396105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.396326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.396512] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.396634] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.396693] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.396910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.397026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.397120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.397214] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.899235] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.402100] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29974051-cea6-4575-91c9-c21beee8c912: rpc.has_security_group_logging(os_id): False [ 1250.433946] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.433946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.433946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.433946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.433946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.434410] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.434410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.434537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.434681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.434755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.434872] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29974051-cea6-4575-91c9-c21beee8c912 is going to be created. [ 1250.524985] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.525233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.525233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.525487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.525732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.538137] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: IN_PROGRESS for 2s [ 1250.838619] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.838619] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1252.552214] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: SUCCESS [ 1252.552717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.642462] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1255.642982] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1255.839482] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.839678] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.198035] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.198035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.198035] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.198484] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.198553] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.198761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.198983] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.199243] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.199396] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.199611] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.199731] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.199844] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.199956] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.200085] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.200197] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.200333] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.222141] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.222345] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1257.222468] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.222653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.222955] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-e45cbbf6-0178-434b-a02a-07021d06c3dd taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.223144] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.223270] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.223686] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.223845] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e45cbbf6-0178-434b-a02a-07021d06c3dd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.726682] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.726921] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.727057] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.727431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.727643] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.727898] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port e45cbbf6-0178-434b-a02a-07021d06c3dd not found, creating... [ 1257.728329] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.728646] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.728827] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.729118] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.729329] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.729647] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.729809] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.729927] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.730160] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.730314] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.730512] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: e45cbbf6-0178-434b-a02a-07021d06c3dd is going to be created. [ 1257.750359] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.750646] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.750806] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.751122] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.751367] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.751593] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.444969] env[69255]: INFO networking_nsxv3.common.synchronization [req-1ac2879d-5886-43f2-b0ef-8f8cabc80af0 req-8f661c7a-80ed-4142-ad8f-69846c6e1fa8 service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1258.445329] env[69255]: INFO networking_nsxv3.common.synchronization [req-1ac2879d-5886-43f2-b0ef-8f8cabc80af0 req-8f661c7a-80ed-4142-ad8f-69846c6e1fa8 service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1258.445329] env[69255]: INFO networking_nsxv3.common.synchronization [req-1ac2879d-5886-43f2-b0ef-8f8cabc80af0 req-8f661c7a-80ed-4142-ad8f-69846c6e1fa8 service nova] Enqueued Resource ID: e45cbbf6-0178-434b-a02a-07021d06c3dd with Priority: HIGHEST for action port [ 1258.445552] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1258.445713] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1258.445828] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45cbbf6-0178-434b-a02a-07021d06c3dd with Priority: HIGHEST for action port [ 1258.446957] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.447106] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.447176] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.447457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.447541] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.448445] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.448555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.448555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.448743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.448919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.449116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.449116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.449216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.449303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.449389] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.450147] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e45cbbf6-0178-434b-a02a-07021d06c3dd taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.451047] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.451187] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.451363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.451444] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e45cbbf6-0178-434b-a02a-07021d06c3dd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.874492] env[69255]: INFO networking_nsxv3.common.synchronization [req-72eaec54-020d-4699-8912-c699a22bcb29 req-9a69ff5d-93fb-4151-8a65-af75670ab453 tempest-ServerActionsTestJSON-2097652254 tempest-ServerActionsTestJSON-2097652254-project-member] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1258.875078] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGHEST for action security_group_members [ 1258.875412] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.875705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.875705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.875864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.876087] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.876203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.876269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.876423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.876564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.877074] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.953029] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.954054] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.954175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.954339] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e45cbbf6-0178-434b-a02a-07021d06c3dd with status ACTIVE [ 1258.954496] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.954600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.954666] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.954861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.954950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.955133] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.955228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.955288] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.955455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.955573] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.955749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.955844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.955906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.959954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.960087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.960183] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e45cbbf6-0178-434b-a02a-07021d06c3dd is going to be updated. [ 1258.980537] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.980753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.980753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.980960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.981118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.981270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.379442] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.379747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.379747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.379875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.379931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.380152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.380277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.380358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.380444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.380520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.380606] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be updated. [ 1259.409152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.409402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.409402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.409538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.409680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.419604] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: IN_PROGRESS for 2s [ 1259.462121] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.964701] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.964937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.964937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.965177] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.965269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.965368] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1259.993679] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.993878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.993878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.994130] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.994299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.002410] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1261.430019] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b in Status: SUCCESS [ 1261.430429] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b deletion is rescheduled due to dependency. [ 1261.430429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.012548] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1262.012774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.012935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.013183] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.013366] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.013483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.013576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.013727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.013809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.013894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.013984] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.516400] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.516791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.516791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.516874] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.517059] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.517165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.517231] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.517370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.517455] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.517545] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.518298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.518298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.518298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.518298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.518298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.518298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.518298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.518620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.518620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.518620] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.518801] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.023020] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b: rpc.has_security_group_logging(os_id): False [ 1263.039323] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.039503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.039619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.039906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.040018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.040245] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.040369] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.040442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.040603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.040706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.040857] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.040960] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.041039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.041159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.041233] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.041425] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.041513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.041574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.041708] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.041781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.041866] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1263.103101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.103265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.103336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.103657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.103817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.117831] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1263.876438] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1263.876714] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1265.139381] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1265.139735] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.420794] env[69255]: INFO networking_nsxv3.common.synchronization [req-169424f3-12d6-45e7-8fbe-14777370cc8d req-a757d25b-607b-4f86-abd5-0e7fc253d6bf tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1267.420794] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGHEST for action security_group_members [ 1267.421103] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.422028] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.422028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.422436] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.925057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.925326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.925413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.925829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.925972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.926283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.926436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.926535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.926860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.927040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.927185] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a is going to be updated. [ 1267.959485] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.959702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.959702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.959910] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.960081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.968379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: IN_PROGRESS for 2s [ 1269.980392] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a in Status: SUCCESS [ 1269.980856] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a deletion is rescheduled due to dependency. [ 1269.980856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.421928] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.422329] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1273.222120] env[69255]: INFO networking_nsxv3.common.synchronization [None req-059e30d3-8fbf-4005-883c-2c248dacda0e tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1273.222120] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1273.222120] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.222120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.222120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.222120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.222120] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.306552] env[69255]: INFO networking_nsxv3.common.synchronization [None req-542c6e55-4f9e-456b-bfc3-099666573fe9 tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1273.307570] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1273.307570] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.307570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.743919] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.744305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.744305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.744401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.744453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.744549] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 already deleted. [ 1273.744633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.744773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.744926] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.745014] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.266631] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.266631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.266631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.267012] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.267141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.267241] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 already deleted. [ 1274.267340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.380437] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.380632] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.380763] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.381043] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.381302] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.381460] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.381583] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.381804] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.381955] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.382183] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1274.382302] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.382418] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.382530] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.382652] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1274.382754] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.382892] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.401307] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.401471] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1274.401615] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.401798] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-48" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.402131] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-e45cbbf6-0178-434b-a02a-07021d06c3dd taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.402308] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.402436] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.402702] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.402849] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e45cbbf6-0178-434b-a02a-07021d06c3dd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.905435] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.905882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.905882] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.906290] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.906419] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.906681] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.906890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.906966] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.907241] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.907404] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.907701] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.907867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.907992] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.908252] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.908408] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.908571] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: e45cbbf6-0178-434b-a02a-07021d06c3dd is going to be updated. [ 1274.932658] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.933030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.933030] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.933307] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.933511] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.933761] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.600543] env[69255]: INFO networking_nsxv3.common.synchronization [req-3029514d-b2c3-4012-9416-31c3e7635be5 req-01b847fa-6490-4b88-8c65-6de2fbf3f29f service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1275.600658] env[69255]: INFO networking_nsxv3.common.synchronization [req-3029514d-b2c3-4012-9416-31c3e7635be5 req-01b847fa-6490-4b88-8c65-6de2fbf3f29f service nova] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1275.600808] env[69255]: INFO networking_nsxv3.common.synchronization [req-3029514d-b2c3-4012-9416-31c3e7635be5 req-01b847fa-6490-4b88-8c65-6de2fbf3f29f service nova] Enqueued Resource ID: e45cbbf6-0178-434b-a02a-07021d06c3dd with Priority: HIGHEST for action port [ 1275.601033] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_rules [ 1275.601172] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1275.601270] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45cbbf6-0178-434b-a02a-07021d06c3dd with Priority: HIGHEST for action port [ 1275.601810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.601966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.602023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.602203] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.602281] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.603072] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.604066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.604066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.604066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.604066] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.604066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.604066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.604066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.604495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.604495] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.605141] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-e45cbbf6-0178-434b-a02a-07021d06c3dd taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.605141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.605141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.605266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.605302] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e45cbbf6-0178-434b-a02a-07021d06c3dd',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.107913] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.107913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.107913] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.108747] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e45cbbf6-0178-434b-a02a-07021d06c3dd with status ACTIVE [ 1276.108942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.109066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.109144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.109358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.109447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.109627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.109741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.109786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.109939] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.110042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.110231] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.110325] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.110413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.110533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.110618] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.110698] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e45cbbf6-0178-434b-a02a-07021d06c3dd is going to be updated. [ 1276.133452] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.133752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.133752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.133911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.134079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.134248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e45cbbf6-0178-434b-a02a-07021d06c3dd" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.613072] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.115960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.116473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.116473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.116473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.116591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.116662] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1277.144723] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.144954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.145026] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.145307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.145535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.154776] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1278.796977] env[69255]: INFO networking_nsxv3.common.synchronization [req-684aef0d-cef6-4483-bdb6-3d5c0e04001b req-b1dcc4b9-c17a-44d1-847d-2b7e51925f26 tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1278.797945] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1278.797945] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.798133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.798193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.798487] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.798646] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.798748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.798807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.798952] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.799041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.799128] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.098779] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.099036] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.099244] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.099531] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.099799] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.099965] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.100105] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.100331] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.100487] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.100757] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.100844] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.100956] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.101113] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.101239] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.101377] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.101519] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.127025] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.127230] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.127458] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.127653] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.127929] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-78a3ccfb-7d0f-40d5-9143-16bbd9129223 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.128452] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.128452] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.128586] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.128732] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a3ccfb-7d0f-40d5-9143-16bbd9129223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.135667] env[69255]: INFO networking_nsxv3.common.synchronization [req-87df7eed-e6ac-40c5-9796-a0f2afef0840 req-2d4e422e-9bae-465a-b170-f85ef4060958 tempest-AttachVolumeNegativeTest-1867189745 tempest-AttachVolumeNegativeTest-1867189745-project-member] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_members [ 1279.136559] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGHEST for action security_group_members [ 1279.137011] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.137143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.137208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.137422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.137576] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.137674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.137733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.137878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.138086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.138086] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.166070] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1279.166070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.166070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.166070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.166070] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.166070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.166466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.166466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.166466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.166466] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.166593] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.301460] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.301664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.301664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.301845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.301963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.302235] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.302385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.302469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.302631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.302711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.302799] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 already deleted. [ 1279.302879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.631189] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.631413] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.631520] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.631801] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.631958] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.632134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 78a3ccfb-7d0f-40d5-9143-16bbd9129223 not found, creating... [ 1279.632402] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.632561] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.632683] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.632908] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.633071] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.633353] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.633512] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.633663] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.633927] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.634208] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.634244] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 is going to be created. [ 1279.639955] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.640113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.640190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.640331] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.640387] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.640570] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.640770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.640770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.640864] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.640924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.640999] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 is going to be updated. [ 1279.656051] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.656051] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.656287] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.656548] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.656791] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.657067] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.668625] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.668776] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.668831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.668995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.669164] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.669263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.669327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.669469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.669549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.669632] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.669774] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.669867] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.669927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.670083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.670379] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.670379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.670379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.670539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.670575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.670648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.670762] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.677540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.677674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.677720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.677883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.678076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.686473] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 in Status: IN_PROGRESS for 2s [ 1280.173347] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b: rpc.has_security_group_logging(os_id): False [ 1280.190810] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.191053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.191053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.191260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.191349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.191550] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.191647] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.191710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.191858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.191934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.192144] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.192239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.192302] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.192439] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.192514] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.192703] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.192798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.192857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.192994] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.193078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.193162] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1280.266299] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.266472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.266586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.266877] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.267046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.285725] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1280.345636] env[69255]: INFO networking_nsxv3.common.synchronization [req-684aef0d-cef6-4483-bdb6-3d5c0e04001b req-02d8b79d-cbb4-4eb5-bdf5-c3c33c777f6d service nova] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1280.345869] env[69255]: INFO networking_nsxv3.common.synchronization [req-684aef0d-cef6-4483-bdb6-3d5c0e04001b req-02d8b79d-cbb4-4eb5-bdf5-c3c33c777f6d service nova] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1280.346028] env[69255]: INFO networking_nsxv3.common.synchronization [req-684aef0d-cef6-4483-bdb6-3d5c0e04001b req-02d8b79d-cbb4-4eb5-bdf5-c3c33c777f6d service nova] Enqueued Resource ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 with Priority: HIGHEST for action port [ 1280.346267] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1280.346400] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1280.346500] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 with Priority: HIGHEST for action port [ 1280.347156] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.347237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.347305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.347510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.347595] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.350073] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.350627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.350627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.350627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.350627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.350627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.350835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.350835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.350908] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.351008] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.351745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-78a3ccfb-7d0f-40d5-9143-16bbd9129223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.351852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.351917] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.352073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.352144] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a3ccfb-7d0f-40d5-9143-16bbd9129223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.854162] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.855279] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.855389] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.855544] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78a3ccfb-7d0f-40d5-9143-16bbd9129223 with status ACTIVE [ 1280.855700] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.855987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.856107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.856349] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.856467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.856689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.856833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.856919] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.857138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.857256] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.857474] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.857596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.857678] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.857850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.857951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.858073] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 is going to be updated. [ 1280.880396] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.880559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.880631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.880839] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.880979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.881148] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.360296] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.696426] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 in Status: SUCCESS [ 1281.696628] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 deletion is rescheduled due to dependency. [ 1281.696710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.862489] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.862646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.862716] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.862930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.863033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.863134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 is going to be created. [ 1281.887275] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.887453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.887501] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.887687] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.887841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.897926] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: UNINITIALIZED for 2s [ 1282.306557] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1282.306824] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.909075] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: SUCCESS [ 1283.909459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.909645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.909943] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.910211] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.910408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.910481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.910697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.910781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.910870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.911032] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.414465] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.666145] env[69255]: INFO networking_nsxv3.common.synchronization [req-2cf28812-7dcd-43ad-ac88-d5bbd97e7b00 req-f3582f34-23a4-4698-a923-f0bd49a81d80 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_members [ 1284.666684] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGHEST for action security_group_members [ 1284.667181] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.667336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.667469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.667696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.667868] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.667972] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.668045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.668226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.668364] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.668465] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.916385] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5232ce03-a604-4502-9f49-52193de2ebe8: rpc.has_security_group_logging(os_id): False [ 1284.935949] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.936153] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.936204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.936443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.936507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.936727] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.936840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.936905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.937077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.937155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.937245] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 is going to be created. [ 1285.007033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.007212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.007261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.007533] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.007793] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.021334] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: IN_PROGRESS for 2s [ 1285.174821] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.175110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.175110] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.175386] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.175503] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.175820] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.175980] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.176040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.176195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.176308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.176407] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 is going to be updated. [ 1285.206527] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.206772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.206829] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.207070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.207299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.218542] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 in Status: IN_PROGRESS for 2s [ 1287.033406] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: SUCCESS [ 1287.033831] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.231677] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 in Status: SUCCESS [ 1287.231914] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 deletion is rescheduled due to dependency. [ 1287.232082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.668167] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.668167] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.885468] env[69255]: INFO networking_nsxv3.common.synchronization [req-0c8ee280-a2e4-4169-80d8-34b4685eb7eb req-dedff76a-1ad8-4dfb-8484-f19832ec49b3 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1292.886075] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1292.886390] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.886547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.886629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.887458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.887458] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.887458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.887458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.887683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.887683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.887834] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.437346] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.894192] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.250405] env[69255]: INFO networking_nsxv3.common.synchronization [req-54c55348-5b42-4e87-9b12-08914635f90c req-cfbf94f5-eca1-435c-b01d-6d51f04b9c3b tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1294.254342] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1294.255033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.256945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.257069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.257322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.257519] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.257654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.257742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.258042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.258042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.258157] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.396780] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.397240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.397336] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.397551] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.397646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.397750] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be updated. [ 1294.430451] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.430654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.430654] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.430992] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.431083] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.441952] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: IN_PROGRESS for 2s [ 1294.565034] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.565249] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.565376] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.565651] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.566546] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.566546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.566546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.566546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.566546] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.566786] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.567350] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.567350] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.567575] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.567722] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.567900] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.567976] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.590528] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.590664] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.590789] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.590977] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.591821] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-553c5fda-0adb-4248-9019-386f8932fda1 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.591821] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.591821] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.592103] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.592103] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('553c5fda-0adb-4248-9019-386f8932fda1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.760614] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.760764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.760875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.761137] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.761240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.761440] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.761540] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.761602] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.761755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.761832] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.761917] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be updated. [ 1294.787635] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.787809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.787860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.788088] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.788396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.797527] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: IN_PROGRESS for 2s [ 1295.095944] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.095944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.095944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.095944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.095944] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.096514] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 553c5fda-0adb-4248-9019-386f8932fda1 not found, creating... [ 1295.096708] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.096928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.097134] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.097428] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.097622] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.097967] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.098226] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.098369] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.098638] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.098818] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.099011] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 553c5fda-0adb-4248-9019-386f8932fda1 is going to be created. [ 1295.124987] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.124987] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.124987] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.124987] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.125301] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.125439] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.794374] env[69255]: INFO networking_nsxv3.common.synchronization [req-54c55348-5b42-4e87-9b12-08914635f90c req-ed5f22e2-0eb7-45aa-bd16-a2c027c9317d service nova] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_rules [ 1295.794564] env[69255]: INFO networking_nsxv3.common.synchronization [req-54c55348-5b42-4e87-9b12-08914635f90c req-ed5f22e2-0eb7-45aa-bd16-a2c027c9317d service nova] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1295.794648] env[69255]: INFO networking_nsxv3.common.synchronization [req-54c55348-5b42-4e87-9b12-08914635f90c req-ed5f22e2-0eb7-45aa-bd16-a2c027c9317d service nova] Enqueued Resource ID: 553c5fda-0adb-4248-9019-386f8932fda1 with Priority: HIGHEST for action port [ 1295.794879] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_rules [ 1295.795012] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1295.795115] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 553c5fda-0adb-4248-9019-386f8932fda1 with Priority: HIGHEST for action port [ 1295.796150] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.796313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.796401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.796622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.796738] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.797610] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.797702] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.798053] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-553c5fda-0adb-4248-9019-386f8932fda1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.798191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.798284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.798457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.798553] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('553c5fda-0adb-4248-9019-386f8932fda1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.300559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.300938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.300938] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 553c5fda-0adb-4248-9019-386f8932fda1 with status ACTIVE [ 1296.301080] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.301192] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.301258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.301467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.301557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.301722] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.301818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.301882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.302041] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.302120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.302298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.302396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.302458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.302615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.302653] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.302757] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 553c5fda-0adb-4248-9019-386f8932fda1 is going to be updated. [ 1296.325508] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.325732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.325732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.325942] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.326104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.326262] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.452063] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1296.452292] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.808136] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1296.808198] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 deletion is rescheduled due to dependency. [ 1296.808333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.808504] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.808720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.808900] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.809035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.809094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.809248] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.809328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.809490] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.311412] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.591677] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.591913] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.591963] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.592265] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.592421] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.814025] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.094745] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.316174] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.316458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.316458] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.316672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.316796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.316922] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be updated. [ 1298.346572] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.346809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.346809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.347133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.347286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.355953] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: IN_PROGRESS for 2s [ 1298.596950] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.797641] env[69255]: INFO networking_nsxv3.common.synchronization [req-ef61807c-37b9-4127-a9c8-9b41257de632 req-34a5c6fc-4571-4d75-a646-35c6450cd8f6 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1298.797641] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGHEST for action security_group_members [ 1298.797968] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.798746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.798746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.798746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.798746] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.798746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.798746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.799051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.799051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.799051] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.099603] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1299.099781] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1299.301965] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.302276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.302276] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.302508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.302615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.302857] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.302979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.303066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.303261] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.303342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.303458] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be updated. [ 1299.405707] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.406199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.406199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.406525] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.406951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.440261] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: IN_PROGRESS for 2s [ 1300.369646] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1300.369646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.369646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.369935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.370017] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.370143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.370210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.370408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.370509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.370599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.370717] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.461689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.462107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.462107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.462360] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.486424] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1300.488017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.489651] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1300.537549] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.537773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.537773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.538031] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.552357] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.553269] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1300.553359] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.553454] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1300.621215] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.621453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.621453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.621655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.622764] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.622947] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1300.739591] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.739830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.739830] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.740019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.740343] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.740676] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1300.838906] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.839174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.839174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.839353] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.839664] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.839986] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1300.840112] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'29974051-cea6-4575-91c9-c21beee8c912', '9fa255da-5c61-407a-a6c5-685ff96ea223', 'cd8fc5f6-8c57-4558-8b42-ae2373cea267', '2fd39125-1025-4df0-b3ea-a2af3c55cee9', '0c485d54-cdff-478c-bfb8-d32fcb0ac9d6', '00293097-1dd1-4554-8c94-171a92644c52', '0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b', 'a1d269b6-2543-4ac4-ba27-81ea5467b07a', '91d1981f-899d-44d8-9b18-06e5c0499d68', '27450723-a78e-460e-9cf1-b908c9e86164', 'f15aa0e7-20c8-41cc-a9da-af90fc09095a', '4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca', 'f33ed09a-fe24-4b0c-9bbd-6935d7eac81b', '1200176c-af01-46da-8315-622c4d3250d8', '0264584e-0080-46af-9c89-3cb2fcd0c26d', '1fca696a-0f49-455d-9cb9-9f974821973b', '0e357209-1eed-448c-9ee5-ec4e2d16d2cb', 'a3c78b55-33cd-47e8-95aa-4dc1be978038', '8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31', 'c1dcc0af-a718-4357-b117-90efbb3d6bec', 'af0234d8-5fb6-4559-8321-eb1748c80ba1', '06e916b5-2321-4083-a362-4d91a75f9d62', '6428cece-54ff-401f-affd-cd4584d1d303', '8b73d257-772b-49ed-a193-0adc505752e2', '8b22e932-32d8-43d0-87bb-f6563236db76', '8f5b8858-9649-4891-ac8f-4f6a330e3a51', '1a2ad9fb-edc6-4825-9f05-2a041fddcce1', '1520d4fa-edba-41bd-8755-7e34c635106e', '0282ecb1-21b7-414b-a78b-410dac72d851', '5232ce03-a604-4502-9f49-52193de2ebe8', '97be36bb-9aa7-4ca4-9b9b-f2f13467259b', '3e4f3999-c21c-4125-ba57-29d87cf22d79', 'bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6', '7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3', 'a1cc7026-1d45-4ec0-a32d-311a913b774a', '39207596-4602-4c59-b143-d5038ebffb91', 'd8f85b08-83ad-443d-9e32-5acb05ba6b8e', '981734c6-752d-40c2-ba2a-3f068cd82111', 'e55ab758-8173-4602-9e5f-c4388eb52159'} {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.840242] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1300.865064] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.865308] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.865373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.865622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.865746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.865892] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1300.866052] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.866223] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1300.872698] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.872854] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.872912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.873279] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.873466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.873581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.873643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.873810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.873895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.874082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.874248] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.874359] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.874416] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.874557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.874699] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.874791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.874847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.874986] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.875076] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.875159] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.875250] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.031311] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.031701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.031833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.032015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.033542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.033971] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1301.034101] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1301.034252] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1301.034252] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1301.034336] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1301.034336] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGH for action security_group_rules [ 1301.034454] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGH for action security_group_rules [ 1301.034500] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGH for action security_group_rules [ 1301.034547] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGH for action security_group_rules [ 1301.034601] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGH for action security_group_rules [ 1301.034649] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGH for action security_group_rules [ 1301.034705] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGH for action security_group_rules [ 1301.034763] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGH for action security_group_rules [ 1301.034819] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGH for action security_group_rules [ 1301.034871] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGH for action security_group_rules [ 1301.034931] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGH for action security_group_rules [ 1301.034983] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGH for action security_group_rules [ 1301.035082] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGH for action security_group_rules [ 1301.035189] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGH for action security_group_rules [ 1301.035254] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGH for action security_group_rules [ 1301.035319] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGH for action security_group_rules [ 1301.035380] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGH for action security_group_rules [ 1301.035431] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGH for action security_group_rules [ 1301.035487] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGH for action security_group_rules [ 1301.035546] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGH for action security_group_rules [ 1301.035648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.377487] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27450723-a78e-460e-9cf1-b908c9e86164: rpc.has_security_group_logging(os_id): False [ 1301.396043] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.396411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.396411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.396575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.418929] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.419208] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.419412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.419412] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.419658] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.419747] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.419982] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.420115] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.420204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.420318] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.420392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.420569] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.420656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.420730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.420856] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.420928] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.421041] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be updated. [ 1301.455815] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb in Status: SUCCESS [ 1301.456126] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb deletion is rescheduled due to dependency. [ 1301.456327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.514729] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.515149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.515149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.515149] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.515339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.530244] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: IN_PROGRESS for 2s [ 1303.192747] env[69255]: INFO networking_nsxv3.common.synchronization [req-7cbae1b6-d8b4-490f-aef0-25de8b69ce58 req-39c0a257-9ec6-4748-ab1c-5307810c4971 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1303.193461] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGHEST for action security_group_members [ 1303.193461] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGH for action security_group_rules [ 1303.193585] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 with Priority: HIGH for action security_group_rules [ 1303.193652] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGH for action security_group_rules [ 1303.193740] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d with Priority: HIGH for action security_group_rules [ 1303.193834] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dcc0af-a718-4357-b117-90efbb3d6bec with Priority: HIGH for action security_group_rules [ 1303.194028] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 with Priority: HIGH for action security_group_rules [ 1303.194094] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 with Priority: HIGH for action security_group_rules [ 1303.194182] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb with Priority: HIGH for action security_group_rules [ 1303.194267] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1200176c-af01-46da-8315-622c4d3250d8 with Priority: HIGH for action security_group_rules [ 1303.194353] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fca696a-0f49-455d-9cb9-9f974821973b with Priority: HIGH for action security_group_rules [ 1303.194428] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b with Priority: HIGH for action security_group_rules [ 1303.194517] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca with Priority: HIGH for action security_group_rules [ 1303.194596] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a with Priority: HIGH for action security_group_rules [ 1303.194676] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27450723-a78e-460e-9cf1-b908c9e86164 with Priority: HIGH for action security_group_rules [ 1303.194809] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 with Priority: HIGH for action security_group_rules [ 1303.194886] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGH for action security_group_rules [ 1303.194952] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a with Priority: HIGH for action security_group_rules [ 1303.195020] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 with Priority: HIGH for action security_group_rules [ 1303.195356] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 with Priority: HIGH for action security_group_rules [ 1303.195470] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 with Priority: HIGH for action security_group_rules [ 1303.195764] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.195888] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.195949] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.196211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.196375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.196476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.196672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.196672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.196772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.196809] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.197665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.197783] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.197861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.197987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.198070] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.198802] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.198907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.198958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.199123] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.199205] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd8fc5f6-8c57-4558-8b42-ae2373cea267',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.199858] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.200198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.200198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.200198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.200298] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.200910] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0264584e-0080-46af-9c89-3cb2fcd0c26d taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.201029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.201105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.201238] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.201312] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0264584e-0080-46af-9c89-3cb2fcd0c26d',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.202102] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1dcc0af-a718-4357-b117-90efbb3d6bec taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.202204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.202273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.202420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.202490] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1dcc0af-a718-4357-b117-90efbb3d6bec',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.203156] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.203272] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.203327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.203467] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.203539] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.204239] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3c78b55-33cd-47e8-95aa-4dc1be978038 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.204344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.204437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.204530] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.204605] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3c78b55-33cd-47e8-95aa-4dc1be978038',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.205369] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.205484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.205546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.205682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.205751] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e357209-1eed-448c-9ee5-ec4e2d16d2cb',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.206430] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1200176c-af01-46da-8315-622c4d3250d8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.206549] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.206610] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.206739] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.206807] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1200176c-af01-46da-8315-622c4d3250d8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.207530] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fca696a-0f49-455d-9cb9-9f974821973b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.207650] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.207711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.207837] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.207920] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fca696a-0f49-455d-9cb9-9f974821973b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.208601] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.208683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.208768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.208883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.208953] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33ed09a-fe24-4b0c-9bbd-6935d7eac81b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.210033] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.210139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.210209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.210344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.210419] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.211064] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.211173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.211237] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.211374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.211585] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f15aa0e7-20c8-41cc-a9da-af90fc09095a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.212092] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27450723-a78e-460e-9cf1-b908c9e86164 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.212182] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.212374] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91d1981f-899d-44d8-9b18-06e5c0499d68 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.212472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.212534] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.212674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.212744] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91d1981f-899d-44d8-9b18-06e5c0499d68',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.215303] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.215471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.215471] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.215697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.215903] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.216480] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.216627] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.216744] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.216836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.216919] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1d269b6-2543-4ac4-ba27-81ea5467b07a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.217571] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.217690] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.217757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.217892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.218052] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c485d54-cdff-478c-bfb8-d32fcb0ac9d6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.218930] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fa255da-5c61-407a-a6c5-685ff96ea223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.219128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.219128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.219340] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.219340] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fa255da-5c61-407a-a6c5-685ff96ea223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.220083] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.220210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.220285] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.220444] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.220444] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fd39125-1025-4df0-b3ea-a2af3c55cee9',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.236713] env[69255]: INFO networking_nsxv3.common.synchronization [req-7cbae1b6-d8b4-490f-aef0-25de8b69ce58 req-39c0a257-9ec6-4748-ab1c-5307810c4971 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 553c5fda-0adb-4248-9019-386f8932fda1 with Priority: HIGHEST for action port [ 1303.239451] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 553c5fda-0adb-4248-9019-386f8932fda1 with Priority: HIGHEST for action port [ 1303.239769] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-553c5fda-0adb-4248-9019-386f8932fda1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.239855] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.239912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.240093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.240173] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('553c5fda-0adb-4248-9019-386f8932fda1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.434850] env[69255]: INFO networking_nsxv3.common.synchronization [None req-090ab450-d75e-4224-9f11-f65f84b47b51 tempest-AttachInterfacesTestJSON-1452735159 tempest-AttachInterfacesTestJSON-1452735159-project-member] Enqueued Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1303.435412] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b with Priority: HIGHEST for action security_group_members [ 1303.435718] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.435841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.435907] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.436421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.436578] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.436726] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.436778] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.436883] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.436966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.437115] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.544371] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1303.544488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.544784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.545036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.545138] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27450723-a78e-460e-9cf1-b908c9e86164',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.722879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.723027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.723138] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.723313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.724820] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.724820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.724820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.724820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.724820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.724820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.724820] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.730808] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.730957] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.731052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.731165] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.731309] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.731401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.731457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.731591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.731667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.731746] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.733489] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.735888] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.736096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.736174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.736268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.736356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.738073] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.738073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.738073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.738073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.738073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.738073] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be updated. [ 1303.755338] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 553c5fda-0adb-4248-9019-386f8932fda1 with status ACTIVE [ 1303.755865] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.755865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.755865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.756146] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.756208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.756356] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.756462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.756523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.756684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.756774] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.756952] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.757053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.757111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.757247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.757315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.757399] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 553c5fda-0adb-4248-9019-386f8932fda1 is going to be updated. [ 1303.817215] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.817407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.817476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.817646] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.819587] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.819741] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.820523] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.820673] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.821308] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.821448] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.823027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.823027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.823027] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.823027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.823653] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.823788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.824803] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.824894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.825534] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.825662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.826403] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.826532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.827167] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.827311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.827881] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.828288] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.828415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.828937] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.829327] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.829477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.829983] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.830376] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.830531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.831110] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.831707] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.831707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.832155] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.832565] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.832685] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.833300] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.833685] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.833777] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.835541] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.835911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.836105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.836257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.836309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.836450] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.836624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-553c5fda-0adb-4248-9019-386f8932fda1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.838987] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.839375] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.839489] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.839546] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.839725] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.839853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.844078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.844200] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91d1981f-899d-44d8-9b18-06e5c0499d68 is going to be deleted. [ 1303.845020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.845212] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.849721] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: IN_PROGRESS for 2s [ 1303.863447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.863650] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f15aa0e7-20c8-41cc-a9da-af90fc09095a is going to be deleted. [ 1303.864468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.864679] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.885380] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.885380] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c485d54-cdff-478c-bfb8-d32fcb0ac9d6 is going to be deleted. [ 1303.886451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.886691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.908893] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.909043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.934036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.934187] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fa255da-5c61-407a-a6c5-685ff96ea223 is going to be deleted. [ 1303.935502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.935502] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.939694] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.939847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.982726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.983709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.983709] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.983709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.985107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.985221] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0264584e-0080-46af-9c89-3cb2fcd0c26d is going to be deleted. [ 1303.986116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.986316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.068547] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.068695] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1dcc0af-a718-4357-b117-90efbb3d6bec is going to be deleted. [ 1304.069842] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.070156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.123033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.123156] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca is going to be deleted. [ 1304.124107] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.124363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.126194] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.126305] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.164244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.164398] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.228909] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.249699] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.249835] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.255668] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.259680] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.259764] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be deleted. [ 1304.260681] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.260901] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.307579] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.307579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.348749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.348950] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.381945] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.382472] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd8fc5f6-8c57-4558-8b42-ae2373cea267 is going to be deleted. [ 1304.383415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.383686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.454541] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.454750] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.464806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.464806] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fd39125-1025-4df0-b3ea-a2af3c55cee9 is going to be deleted. [ 1304.465768] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.465991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.532469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.533173] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3c78b55-33cd-47e8-95aa-4dc1be978038 is going to be deleted. [ 1304.534035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.534147] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.596508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.596701] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e357209-1eed-448c-9ee5-ec4e2d16d2cb is going to be deleted. [ 1304.597583] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.597806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.624745] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.625017] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.632551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.632759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.665144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.665429] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33ed09a-fe24-4b0c-9bbd-6935d7eac81b is going to be deleted. [ 1304.666847] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.667190] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.669905] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.670051] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.710244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.710586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.732134] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00293097-1dd1-4554-8c94-171a92644c52: rpc.has_security_group_logging(os_id): False [ 1304.758091] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29974051-cea6-4575-91c9-c21beee8c912: rpc.has_security_group_logging(os_id): False [ 1304.778476] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.778662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.796813] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.797099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.821723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.821897] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1200176c-af01-46da-8315-622c4d3250d8 is going to be deleted. [ 1304.823093] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.823410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.839515] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.839721] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.912098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.912386] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1d269b6-2543-4ac4-ba27-81ea5467b07a is going to be deleted. [ 1304.913393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.913633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.966379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.966810] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fca696a-0f49-455d-9cb9-9f974821973b is going to be deleted. [ 1304.967862] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.968121] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.994484] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.994710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.024641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.025305] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31 is going to be deleted. [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91d1981f-899d-44d8-9b18-06e5c0499d68" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.028315] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.028926] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.029085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.029163] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.030488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.030488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.030488] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b is going to be updated. [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c485d54-cdff-478c-bfb8-d32fcb0ac9d6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.034021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f15aa0e7-20c8-41cc-a9da-af90fc09095a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.034639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.034897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.035103] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.035322] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 is going to be deleted. [ 1305.036723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.037096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.037312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.037575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fa255da-5c61-407a-a6c5-685ff96ea223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.037876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.038219] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.038431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.038668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0264584e-0080-46af-9c89-3cb2fcd0c26d" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.039327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.039603] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.039798] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.040046] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1dcc0af-a718-4357-b117-90efbb3d6bec" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.040286] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.040808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.040808] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.041271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4df0dbe3-1ac2-4f14-9052-eca7dd5aa6ca" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.041374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.041624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.041806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.042023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.042240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.042451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.042587] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.042785] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd8fc5f6-8c57-4558-8b42-ae2373cea267" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.042977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.043196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.043327] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.043509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fd39125-1025-4df0-b3ea-a2af3c55cee9" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.043696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.043894] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.044061] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.044244] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3c78b55-33cd-47e8-95aa-4dc1be978038" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.044569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.044724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.044853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.045492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e357209-1eed-448c-9ee5-ec4e2d16d2cb" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.049084] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1d269b6-2543-4ac4-ba27-81ea5467b07a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33ed09a-fe24-4b0c-9bbd-6935d7eac81b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.049084] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.075816] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.076393] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.076858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.076858] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.077072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.077118] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.077451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29974051-cea6-4575-91c9-c21beee8c912 is going to be updated. [ 1305.079869] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.080263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.080485] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.080755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1200176c-af01-46da-8315-622c4d3250d8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.081098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.081403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.083943] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.084294] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.084473] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.084786] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.085075] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.103951] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: IN_PROGRESS for 2s [ 1305.407439] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.408508] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.413960] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.414164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.418469] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.418662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.424827] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.425307] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.425307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.425453] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.425529] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.425600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.425801] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be updated. [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fca696a-0f49-455d-9cb9-9f974821973b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4b6a1d-5bbb-4188-8f01-ae3aa41ced31" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.428304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.532060] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.532060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.532060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.532321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.532321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.596290] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: IN_PROGRESS for 2s [ 1305.670724] env[69255]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1305.671340] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.671531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.671622] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.671868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.672042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.686306] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1305.859591] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27450723-a78e-460e-9cf1-b908c9e86164 in Status: SUCCESS [ 1305.859782] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27450723-a78e-460e-9cf1-b908c9e86164 deletion is rescheduled due to dependency. [ 1305.859896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27450723-a78e-460e-9cf1-b908c9e86164" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.114434] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b in Status: SUCCESS [ 1307.114804] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b deletion is rescheduled due to dependency. [ 1307.114804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0788cc63-30b1-4d9a-8e8f-4d8d1f45ed4b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.612373] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: SUCCESS [ 1307.612373] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.700225] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1307.700225] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.151712] env[69255]: INFO networking_nsxv3.common.synchronization [None req-cc60ae43-1be3-4719-b98b-368c0cbb348b None None] Enqueued Resource ID: c43cc721-46e2-4bac-98da-dc85d4163a10 with Priority: HIGHEST for action port [ 1308.151712] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43cc721-46e2-4bac-98da-dc85d4163a10 with Priority: HIGHEST for action port [ 1308.151971] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-c43cc721-46e2-4bac-98da-dc85d4163a10 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.152065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c43cc721-46e2-4bac-98da-dc85d4163a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.152113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c43cc721-46e2-4bac-98da-dc85d4163a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.152370] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c43cc721-46e2-4bac-98da-dc85d4163a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.152543] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c43cc721-46e2-4bac-98da-dc85d4163a10',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.403702] env[69255]: INFO networking_nsxv3.common.synchronization [None req-94efef71-63c6-4ff5-ba75-e7c15d3664f0 tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1308.405295] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1308.405295] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.405295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.405295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.405295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.405295] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.488488] env[69255]: INFO networking_nsxv3.common.synchronization [None req-182e7b57-aee8-495a-b09d-c56fec59bf1e tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1308.488488] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1308.488488] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.488488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.654922] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c43cc721-46e2-4bac-98da-dc85d4163a10 [ 1308.655184] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.655321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.655391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.655600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.655688] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.655779] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c43cc721-46e2-4bac-98da-dc85d4163a10 already deleted. [ 1308.655860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c43cc721-46e2-4bac-98da-dc85d4163a10" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.934627] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.934788] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.934879] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.935109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.935202] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.935296] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 already deleted. [ 1308.935381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.935524] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.935672] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.935753] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.458836] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.459264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.459264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.459363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.459396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.459529] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 already deleted. [ 1309.459586] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.965337] env[69255]: INFO networking_nsxv3.common.synchronization [None req-21c21bb1-2a1e-4396-a1ca-3f232761046f None None] Enqueued Resource ID: bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0 with Priority: HIGHEST for action port [ 1309.969643] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0 with Priority: HIGHEST for action port [ 1309.970412] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.970588] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.970675] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.970935] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.971055] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.474065] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0 [ 1310.474065] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.474065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.474065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.474065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.474065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.474065] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0 already deleted. [ 1310.474065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc1b1e8a-6e52-4529-ba7d-3f0fddb6ddb0" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.879205] env[69255]: INFO networking_nsxv3.common.synchronization [req-fba35ccc-53d7-4f9f-a845-48ecb9fbabe3 req-1a9bc168-4ab2-45fb-ab10-21cd21422413 tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1313.879753] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1313.880107] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.880201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.880396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.880555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.880712] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.880812] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.880881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.881015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.881094] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.881224] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.162267] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.162493] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.162622] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.162945] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.163228] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.163390] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.163511] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.163734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.163886] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.164360] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1314.164494] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1314.164615] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1314.164742] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1314.164875] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1314.164978] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1314.165127] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1314.185356] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1314.185529] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1314.185692] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1314.185839] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.186186] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-9ef02e7f-078e-4cfe-b608-555b3531f327 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.186358] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.186484] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.186807] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.186946] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ef02e7f-078e-4cfe-b608-555b3531f327',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.387487] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.387684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.387730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.387937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.388052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.388337] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.388443] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.388506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.388659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.388738] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.388824] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 already deleted. [ 1314.388904] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.689249] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.689501] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.689646] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.689930] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.690106] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.690310] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 9ef02e7f-078e-4cfe-b608-555b3531f327 not found, creating... [ 1314.690628] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.690804] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.690963] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.691265] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.691479] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.691785] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.692006] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.692176] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.692402] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.692545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.692695] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 9ef02e7f-078e-4cfe-b608-555b3531f327 is going to be created. [ 1314.712286] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.712449] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.712567] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.712873] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.713165] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.713432] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.477051] env[69255]: INFO networking_nsxv3.common.synchronization [req-fba35ccc-53d7-4f9f-a845-48ecb9fbabe3 req-3f4a998c-ecbb-440e-89dd-7ea1c2a48446 service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1315.477408] env[69255]: INFO networking_nsxv3.common.synchronization [req-fba35ccc-53d7-4f9f-a845-48ecb9fbabe3 req-3f4a998c-ecbb-440e-89dd-7ea1c2a48446 service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1315.477408] env[69255]: INFO networking_nsxv3.common.synchronization [req-fba35ccc-53d7-4f9f-a845-48ecb9fbabe3 req-3f4a998c-ecbb-440e-89dd-7ea1c2a48446 service nova] Enqueued Resource ID: 9ef02e7f-078e-4cfe-b608-555b3531f327 with Priority: HIGHEST for action port [ 1315.477717] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1315.478623] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1315.478623] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef02e7f-078e-4cfe-b608-555b3531f327 with Priority: HIGHEST for action port [ 1315.481321] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.481321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.481321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.481321] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.481321] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.481947] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.482109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.482207] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.482426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.482612] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.482742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.482828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.483006] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.483142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.483264] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.484780] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ef02e7f-078e-4cfe-b608-555b3531f327 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.484780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.484780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.484780] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.484780] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ef02e7f-078e-4cfe-b608-555b3531f327',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.986732] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.987782] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.987946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.988076] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ef02e7f-078e-4cfe-b608-555b3531f327 with status ACTIVE [ 1315.988236] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.988344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.988409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.988639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.988732] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.988903] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.989016] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.989070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.989226] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.989303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.989478] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.989576] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.989633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.989763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.989836] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.989914] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ef02e7f-078e-4cfe-b608-555b3531f327 is going to be updated. [ 1316.013347] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.013570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.013570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.013818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.013969] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.014150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ef02e7f-078e-4cfe-b608-555b3531f327" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.492050] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.993968] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.994259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.994259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.994431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.994526] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.994631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be created. [ 1317.019888] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.020111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.020111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.020260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.020421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.031249] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: UNINITIALIZED for 2s [ 1319.041725] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1319.042019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.042114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.042322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.042518] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.042638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.042703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.042893] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.042981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.043085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.043178] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.546286] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.049215] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 656cb5a0-018b-4c85-98d9-26ec41583250: rpc.has_security_group_logging(os_id): False [ 1320.068229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.068409] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.068464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.068651] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.068733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.068972] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.069087] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.069150] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.069298] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.069374] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.069461] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be created. [ 1320.128465] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.128724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.128724] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.128898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.129096] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.141786] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1320.479612] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.479830] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1322.156535] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1322.156898] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.552595] env[69255]: INFO networking_nsxv3.common.synchronization [req-bf14510a-345f-4912-9362-3cc50e706af3 req-789e1b05-f981-415d-ab9d-380dca936e5a tempest-AttachVolumeTestJSON-1340177931 tempest-AttachVolumeTestJSON-1340177931-project-member] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_members [ 1322.552741] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGHEST for action security_group_members [ 1322.553060] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.553312] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.553420] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.553601] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.554317] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.554317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.554317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.554317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.554317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.554317] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.056418] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.056635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.056754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.056911] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.057015] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.057217] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.057326] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.057403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.057513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.057585] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.057668] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29974051-cea6-4575-91c9-c21beee8c912 is going to be updated. [ 1323.085465] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.085701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.085701] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.085876] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.086025] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.099805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: IN_PROGRESS for 2s [ 1325.110868] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29974051-cea6-4575-91c9-c21beee8c912 in Status: SUCCESS [ 1325.111301] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29974051-cea6-4575-91c9-c21beee8c912 deletion is rescheduled due to dependency. [ 1325.111301] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.687567] env[69255]: INFO networking_nsxv3.common.synchronization [req-589721cf-a6ac-4e01-9461-64ae5509509c req-f8c1bd50-a834-481c-8f88-361714709a4b tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1326.687961] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1326.688282] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.688406] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.688472] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.688697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.688857] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.688954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.689013] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.689328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.689424] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.689517] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.961881] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.961881] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.962088] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.962206] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.962473] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.962636] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.962758] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.962977] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.963142] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.963359] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1326.963480] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1326.963592] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1326.963703] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1326.963816] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1326.963924] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1326.964073] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1326.984777] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1326.984990] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1326.985128] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1326.985311] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-58" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.985639] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.985788] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.985910] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.986275] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.986501] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.191961] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.488774] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.488981] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.489131] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.489426] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.489722] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.489788] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b not found, creating... [ 1327.490090] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.490228] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.490382] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.490641] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.490890] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.491122] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.491287] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.491431] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.491650] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.491790] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.491931] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b is going to be created. [ 1327.513663] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.513816] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.513867] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.515058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.515058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.515058] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.694667] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.189586] env[69255]: INFO networking_nsxv3.common.synchronization [req-589721cf-a6ac-4e01-9461-64ae5509509c req-0d21c429-2ed1-474a-ad69-36c27a874147 service nova] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1328.189743] env[69255]: INFO networking_nsxv3.common.synchronization [req-589721cf-a6ac-4e01-9461-64ae5509509c req-0d21c429-2ed1-474a-ad69-36c27a874147 service nova] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1328.189823] env[69255]: INFO networking_nsxv3.common.synchronization [req-589721cf-a6ac-4e01-9461-64ae5509509c req-0d21c429-2ed1-474a-ad69-36c27a874147 service nova] Enqueued Resource ID: 830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b with Priority: HIGHEST for action port [ 1328.190135] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_rules [ 1328.190235] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1328.190280] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b with Priority: HIGHEST for action port [ 1328.190828] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.190954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.191024] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.191227] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.191364] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.192198] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.192291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.192619] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.192619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.192619] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.192790] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.192866] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.197637] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.197637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.197637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.197637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.197637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.197637] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be updated. [ 1328.227550] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.227763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.227763] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.228023] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.228209] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.238314] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1328.694390] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.694535] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.694755] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b with status ACTIVE [ 1328.694992] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.695069] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.695109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.695316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.695405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.695622] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.695727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.695791] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.695975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.696043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.696211] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.696303] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.696392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.696517] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.696584] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.696671] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b is going to be updated. [ 1328.719994] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.720188] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.720232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.720435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.720568] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.720719] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-830c2a6e-d9d7-4f10-b2c2-9b0241e1aa7b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.249962] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1330.250299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.250299] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.251021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.251021] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.251021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.251021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.251021] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.251284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.251284] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.753914] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.256785] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.760095] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.760371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.760371] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.760761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.760761] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.760955] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be updated. [ 1331.805189] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.805399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.805399] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.805594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.805754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.823857] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1333.191966] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.192437] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1333.845877] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1333.846222] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.846437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.846696] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.846898] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.847049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.847141] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.847322] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.847403] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.847506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.847580] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.350461] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.853379] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00293097-1dd1-4554-8c94-171a92644c52: rpc.has_security_group_logging(os_id): False [ 1334.872262] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.872457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.872457] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.872676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.872676] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.872948] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.873072] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.873142] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.873296] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.873437] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.873534] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be updated. [ 1334.943299] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.943536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.943536] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.943938] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.944078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.960648] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1336.985578] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1336.985578] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.192579] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.193026] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1343.193354] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.193736] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.194617] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.195022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.195453] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.195872] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.795949] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.796162] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.796324] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.796611] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.796911] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.797525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.797525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.797525] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.797709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.797796] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1353.797932] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1353.798056] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1353.798168] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1353.798279] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1353.798383] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1353.798514] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1353.819137] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1353.819320] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1353.819464] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1353.819691] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-514" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.820033] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-78a3ccfb-7d0f-40d5-9143-16bbd9129223 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.820220] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.820349] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.820617] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.820758] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a3ccfb-7d0f-40d5-9143-16bbd9129223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.323428] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.323861] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.323861] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.324079] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.324237] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.324530] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.324710] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.324855] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.325098] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.325246] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.325531] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.325692] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.325815] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.326042] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.326184] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.326332] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 is going to be updated. [ 1354.349700] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.349700] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.349700] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.349996] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.350139] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.350922] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.019022] env[69255]: INFO networking_nsxv3.common.synchronization [req-cc11fb6e-15d2-4015-b929-5a09349bdb21 req-6873c93b-7b58-4e4d-9a94-68acc4e18c64 service nova] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1355.019022] env[69255]: INFO networking_nsxv3.common.synchronization [req-cc11fb6e-15d2-4015-b929-5a09349bdb21 req-6873c93b-7b58-4e4d-9a94-68acc4e18c64 service nova] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1355.019022] env[69255]: INFO networking_nsxv3.common.synchronization [req-cc11fb6e-15d2-4015-b929-5a09349bdb21 req-6873c93b-7b58-4e4d-9a94-68acc4e18c64 service nova] Enqueued Resource ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 with Priority: HIGHEST for action port [ 1355.019022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_rules [ 1355.019022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1355.019022] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 with Priority: HIGHEST for action port [ 1355.019898] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.020402] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.020674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.021102] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.021587] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.023038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.023174] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.023247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.023451] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.023665] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.023814] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.024040] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.024214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.024432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.025036] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.025851] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-78a3ccfb-7d0f-40d5-9143-16bbd9129223 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.026145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.026236] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.026464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.026613] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a3ccfb-7d0f-40d5-9143-16bbd9129223',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.530103] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.531160] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.531289] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.531622] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78a3ccfb-7d0f-40d5-9143-16bbd9129223 with status ACTIVE [ 1355.531787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.531896] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.531964] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.532178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.532267] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.532433] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.532531] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.532596] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.532733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.532807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.532979] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.533269] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.533351] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.533433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.533505] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.533591] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78a3ccfb-7d0f-40d5-9143-16bbd9129223 is going to be updated. [ 1355.557302] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.557469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.557532] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.557712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.557844] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.558014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78a3ccfb-7d0f-40d5-9143-16bbd9129223" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.032567] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.535773] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.536255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.536255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.536255] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.536400] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.536497] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 is going to be updated. [ 1356.569117] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.569377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.569377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.569609] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.569811] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.580610] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: IN_PROGRESS for 2s [ 1358.592551] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: SUCCESS [ 1358.592933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.592933] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.593201] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.593426] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.593541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.593580] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.593710] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.593784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.593870] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.593959] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.096230] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.599032] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5232ce03-a604-4502-9f49-52193de2ebe8: rpc.has_security_group_logging(os_id): False [ 1359.619292] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.619523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.619630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.619936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.642843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.643220] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.643378] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.643454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.643611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.643695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.643784] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 is going to be updated. [ 1359.710035] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.710354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.710354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.710554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.710731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.725483] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: IN_PROGRESS for 2s [ 1360.019484] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.019663] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1361.741650] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: SUCCESS [ 1361.742054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.020518] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.021047] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.021575] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.022084] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.023208] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.023578] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.024384] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.024795] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.025463] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.025862] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.026985] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.027402] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.028029] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.028029] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.222543] env[69255]: INFO networking_nsxv3.common.synchronization [req-e8a264db-311f-4eaa-9581-deb917a1b23e req-8e21a2b5-acab-48da-b343-934d124453a4 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1397.222905] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1397.223611] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.223611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.223611] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.223892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.223892] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.224126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.224126] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.224234] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.224818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.224818] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.727397] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.230192] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.733065] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.733291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.733291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.733469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.733564] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.733665] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be updated. [ 1398.763434] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.763697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.763697] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.763828] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.763977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.772631] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1400.783885] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1400.784283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.224074] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.224511] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.225734] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.225734] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.082737] env[69255]: INFO networking_nsxv3.common.synchronization [req-f97b92be-53dc-476e-9fba-0cc43b88ac59 req-163c9710-5ded-471d-8b30-d70fa20cac9b tempest-AttachVolumeShelveTestJSON-55733425 tempest-AttachVolumeShelveTestJSON-55733425-project-member] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1408.083322] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGHEST for action security_group_members [ 1408.083640] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.083748] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.083840] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.084019] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.084173] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.084263] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.084319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.084462] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.084556] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.084618] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.586851] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.587332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.587332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.587431] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.587565] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.587689] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.587782] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.587849] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.588027] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.588120] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.588218] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 is going to be updated. [ 1408.624391] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.624720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.624720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.624852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.624958] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.634607] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: IN_PROGRESS for 2s [ 1410.645249] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5232ce03-a604-4502-9f49-52193de2ebe8 in Status: SUCCESS [ 1410.645641] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 deletion is rescheduled due to dependency. [ 1410.645641] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.084702] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.085197] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.933675] env[69255]: INFO networking_nsxv3.common.synchronization [req-431964bc-e89f-4eb5-afa3-0c9f2a2a909d req-793eb3da-d294-4b90-805f-c5a71cd25c79 tempest-ServerActionsTestOtherA-455865557 tempest-ServerActionsTestOtherA-455865557-project-member] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1413.933792] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGHEST for action security_group_members [ 1413.934106] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.934268] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.934348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.934558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.934838] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.934838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.935050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.935113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.935173] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.935242] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.437795] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.438250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.438250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.438341] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.438425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.438641] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.438743] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.438804] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.438985] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.439144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.439266] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be updated. [ 1414.468724] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.468906] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.468955] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.469164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.469339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.477272] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: IN_PROGRESS for 2s [ 1416.487987] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00293097-1dd1-4554-8c94-171a92644c52 in Status: SUCCESS [ 1416.487987] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00293097-1dd1-4554-8c94-171a92644c52 deletion is rescheduled due to dependency. [ 1416.487987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.934776] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.935233] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.936220] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.936687] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.937724] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.937724] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.938398] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.938835] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.939694] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.940157] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.941011] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.941011] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.297406] env[69255]: INFO networking_nsxv3.common.synchronization [req-2d0922dd-bd10-49c6-aa8a-9458b63b5c41 req-dfdc86e2-ac8c-47ff-8ec4-7929d94b81dc tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1446.297939] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1446.298253] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.298377] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.298454] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.298635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.299281] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.299281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.299281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.299281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.299281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.299657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.801616] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.801781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.801865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.802080] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.802172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.802359] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.802459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.802513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.802659] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.803085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.803085] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1446.830721] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.830977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.830977] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.831367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.831367] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.839456] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1448.851436] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1448.851951] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 deletion is rescheduled due to dependency. [ 1448.851951] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.299419] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.299783] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.892139] env[69255]: INFO networking_nsxv3.common.synchronization [req-db694fc7-5ea7-41a1-a78c-e1db4cc5cff1 req-d81244d4-406c-453d-8946-deac72d90801 tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1453.892139] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1453.892139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.892139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.892139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.892139] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.892139] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.893362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.893570] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.893822] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.896757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.896757] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.162067] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.162067] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.162067] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.162305] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.162530] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.162704] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.162893] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.163225] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.163472] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.163818] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1454.163999] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1454.164146] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1454.164267] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1454.164392] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1454.164503] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1454.164640] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1454.187904] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1454.188157] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1454.188243] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1454.188397] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.188710] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-692b466a-85c1-4725-9ad8-ed4c5776daac taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.188883] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.189016] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.189434] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.189585] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692b466a-85c1-4725-9ad8-ed4c5776daac',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.399559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.399838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.399838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.399934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.400070] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.400272] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.400410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.400475] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.400637] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.400727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.400782] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1454.425551] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.425833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.425833] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.425971] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.426077] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.435902] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1454.692567] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.692841] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.692841] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.693160] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.693319] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.693495] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 692b466a-85c1-4725-9ad8-ed4c5776daac not found, creating... [ 1454.693779] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.693935] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.694068] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.694306] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.694575] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.695048] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.695363] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.695660] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.695949] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.696196] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.696433] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 692b466a-85c1-4725-9ad8-ed4c5776daac is going to be created. [ 1454.716227] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.716443] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.716604] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.716877] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.717446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.717446] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.379539] env[69255]: INFO networking_nsxv3.common.synchronization [req-db694fc7-5ea7-41a1-a78c-e1db4cc5cff1 req-60488382-24ac-44cd-b589-86a1166beecd service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1455.379874] env[69255]: INFO networking_nsxv3.common.synchronization [req-db694fc7-5ea7-41a1-a78c-e1db4cc5cff1 req-60488382-24ac-44cd-b589-86a1166beecd service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1455.379874] env[69255]: INFO networking_nsxv3.common.synchronization [req-db694fc7-5ea7-41a1-a78c-e1db4cc5cff1 req-60488382-24ac-44cd-b589-86a1166beecd service nova] Enqueued Resource ID: 692b466a-85c1-4725-9ad8-ed4c5776daac with Priority: HIGHEST for action port [ 1455.380093] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1455.380226] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1455.380333] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 692b466a-85c1-4725-9ad8-ed4c5776daac with Priority: HIGHEST for action port [ 1455.380864] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.380991] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.381129] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.381333] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.381414] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.382268] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.382410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.382623] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-692b466a-85c1-4725-9ad8-ed4c5776daac taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.382703] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.382770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.382925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.382999] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692b466a-85c1-4725-9ad8-ed4c5776daac',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.884685] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 692b466a-85c1-4725-9ad8-ed4c5776daac with status ACTIVE [ 1455.884917] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.885100] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.885144] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.885357] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.885440] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.885616] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.885713] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.885770] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.885915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.885990] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.886180] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.886282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.886354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.886483] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.886554] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.886638] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 692b466a-85c1-4725-9ad8-ed4c5776daac is going to be updated. [ 1455.887776] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.887875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.907779] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.907993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.907993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.908178] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.908319] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.908479] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-692b466a-85c1-4725-9ad8-ed4c5776daac" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.446451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1456.446810] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 deletion is rescheduled due to dependency. [ 1456.446810] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.446930] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.447127] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.447313] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1456.447432] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1456.447482] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1456.447633] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1456.447709] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1456.447807] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1456.949791] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.452288] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1457.954555] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.954723] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.954815] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.955028] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.955112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.955208] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1457.983161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1457.983385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1457.983385] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1457.983591] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1457.984881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1457.992053] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1460.003656] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1460.003656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.003656] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.004128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.004128] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.004128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.004128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.004396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.004396] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.004495] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.004612] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.381827] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.382052] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1460.506734] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.009952] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 656cb5a0-018b-4c85-98d9-26ec41583250: rpc.has_security_group_logging(os_id): False [ 1461.027884] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.028145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.028145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.028316] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.028408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.028658] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.028753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.028819] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.028966] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.029052] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.029141] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1461.086833] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.087086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.087086] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.087280] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.087464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.098492] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1463.112595] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1463.112989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.382863] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.382863] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.383703] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.383703] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.384360] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.384741] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.384971] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.385398] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.386408] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.386851] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.388418] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.388866] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.390091] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.390570] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.643342] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1495.643533] env[69255]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-3cb2cf88-e14a-46c6-9b37-8af7ff01bd77 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1500.391249] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.391682] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.392460] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.392944] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.394059] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.394414] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.394723] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.395296] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.395913] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.395913] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.397078] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.397562] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.398417] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.398792] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.399607] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.400079] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.596514] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.596912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.596912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.597020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.597124] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.099524] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.602156] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.105123] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1539.105123] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1540.041255] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.041684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.041684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.041684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.052862] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1540.053730] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.054955] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1540.092725] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.092975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.092975] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.093191] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.106789] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.107662] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1540.107758] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.107838] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1540.141563] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.141865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.141865] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.142060] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.142712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.142867] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1540.232079] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.232079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.232079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.232079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.232079] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.232434] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1540.308532] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.308753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.308753] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.308932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.309259] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.309531] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:22. [ 1540.309621] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'29974051-cea6-4575-91c9-c21beee8c912', '00293097-1dd1-4554-8c94-171a92644c52', 'af0234d8-5fb6-4559-8321-eb1748c80ba1', '06e916b5-2321-4083-a362-4d91a75f9d62', '6428cece-54ff-401f-affd-cd4584d1d303', '8b73d257-772b-49ed-a193-0adc505752e2', '8b22e932-32d8-43d0-87bb-f6563236db76', '8f5b8858-9649-4891-ac8f-4f6a330e3a51', '1a2ad9fb-edc6-4825-9f05-2a041fddcce1', '1520d4fa-edba-41bd-8755-7e34c635106e', '0282ecb1-21b7-414b-a78b-410dac72d851', '656cb5a0-018b-4c85-98d9-26ec41583250', '5232ce03-a604-4502-9f49-52193de2ebe8', '97be36bb-9aa7-4ca4-9b9b-f2f13467259b', '3e4f3999-c21c-4125-ba57-29d87cf22d79', 'bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6', '7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3', 'a1cc7026-1d45-4ec0-a32d-311a913b774a', '39207596-4602-4c59-b143-d5038ebffb91', 'd8f85b08-83ad-443d-9e32-5acb05ba6b8e', '981734c6-752d-40c2-ba2a-3f068cd82111', 'e55ab758-8173-4602-9e5f-c4388eb52159'} {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.309802] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1540.329879] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.330111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.330111] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.330297] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.330382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.330492] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1540.330564] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.330633] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1540.400364] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.400513] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.407145] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.407344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.407344] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.407528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.408662] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.408911] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1540.408982] env[69255]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69255) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1540.409068] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1540.409135] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1540.409212] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/22 resources of Type:Security Group Rules [ 1540.409284] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGH for action security_group_rules [ 1540.409379] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGH for action security_group_rules [ 1540.409439] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGH for action security_group_rules [ 1540.409516] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGH for action security_group_rules [ 1540.409559] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGH for action security_group_rules [ 1540.409594] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGH for action security_group_rules [ 1540.409662] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGH for action security_group_rules [ 1540.409717] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGH for action security_group_rules [ 1540.409772] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGH for action security_group_rules [ 1540.409830] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGH for action security_group_rules [ 1540.409885] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGH for action security_group_rules [ 1540.409947] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGH for action security_group_rules [ 1540.410019] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGH for action security_group_rules [ 1540.410078] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGH for action security_group_rules [ 1540.410125] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGH for action security_group_rules [ 1540.410184] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGH for action security_group_rules [ 1540.410237] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGH for action security_group_rules [ 1540.410300] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGH for action security_group_rules [ 1540.410353] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGH for action security_group_rules [ 1540.410408] env[69255]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGH for action security_group_rules [ 1540.410509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.402137] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.402607] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1545.402607] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29974051-cea6-4575-91c9-c21beee8c912 with Priority: HIGH for action security_group_rules [ 1545.402746] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 with Priority: HIGH for action security_group_rules [ 1545.405235] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b22e932-32d8-43d0-87bb-f6563236db76 with Priority: HIGH for action security_group_rules [ 1545.405445] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 with Priority: HIGH for action security_group_rules [ 1545.405592] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e with Priority: HIGH for action security_group_rules [ 1545.405729] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39207596-4602-4c59-b143-d5038ebffb91 with Priority: HIGH for action security_group_rules [ 1545.405859] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cc7026-1d45-4ec0-a32d-311a913b774a with Priority: HIGH for action security_group_rules [ 1545.405989] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 with Priority: HIGH for action security_group_rules [ 1545.406139] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b with Priority: HIGH for action security_group_rules [ 1545.406272] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 with Priority: HIGH for action security_group_rules [ 1545.406402] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5232ce03-a604-4502-9f49-52193de2ebe8 with Priority: HIGH for action security_group_rules [ 1545.406533] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGH for action security_group_rules [ 1545.406661] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0282ecb1-21b7-414b-a78b-410dac72d851 with Priority: HIGH for action security_group_rules [ 1545.406800] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1520d4fa-edba-41bd-8755-7e34c635106e with Priority: HIGH for action security_group_rules [ 1545.406928] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 with Priority: HIGH for action security_group_rules [ 1545.407064] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b73d257-772b-49ed-a193-0adc505752e2 with Priority: HIGH for action security_group_rules [ 1545.407190] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 with Priority: HIGH for action security_group_rules [ 1545.407337] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6428cece-54ff-401f-affd-cd4584d1d303 with Priority: HIGH for action security_group_rules [ 1545.407433] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00293097-1dd1-4554-8c94-171a92644c52 with Priority: HIGH for action security_group_rules [ 1545.407552] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e916b5-2321-4083-a362-4d91a75f9d62 with Priority: HIGH for action security_group_rules [ 1545.407980] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29974051-cea6-4575-91c9-c21beee8c912 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.408170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.408250] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.408491] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.408585] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29974051-cea6-4575-91c9-c21beee8c912',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.409787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af0234d8-5fb6-4559-8321-eb1748c80ba1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.409937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.410035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.410251] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.410364] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af0234d8-5fb6-4559-8321-eb1748c80ba1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.411298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b22e932-32d8-43d0-87bb-f6563236db76 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.411413] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.411477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.411644] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.411720] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b22e932-32d8-43d0-87bb-f6563236db76',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.412636] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4f3999-c21c-4125-ba57-29d87cf22d79 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.412772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.412859] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.413199] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.413337] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4f3999-c21c-4125-ba57-29d87cf22d79',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.414101] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.414215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.414277] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.414417] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.414672] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f85b08-83ad-443d-9e32-5acb05ba6b8e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.415152] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39207596-4602-4c59-b143-d5038ebffb91 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.415273] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.415338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.415486] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.415566] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39207596-4602-4c59-b143-d5038ebffb91',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.416280] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1cc7026-1d45-4ec0-a32d-311a913b774a taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.416490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.416559] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.416704] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.416798] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1cc7026-1d45-4ec0-a32d-311a913b774a',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.417995] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.418136] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.418204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.418358] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.418432] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.419548] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.419655] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.419712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.419861] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.419933] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97be36bb-9aa7-4ca4-9b9b-f2f13467259b',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.420914] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.421033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.421098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.421247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.421314] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.422625] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5232ce03-a604-4502-9f49-52193de2ebe8 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.422784] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.423140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.423324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.423706] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5232ce03-a604-4502-9f49-52193de2ebe8',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.424398] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.424512] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.424566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.424705] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.424819] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.425690] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0282ecb1-21b7-414b-a78b-410dac72d851 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.425797] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.425860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.426029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.426098] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0282ecb1-21b7-414b-a78b-410dac72d851',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.427234] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1520d4fa-edba-41bd-8755-7e34c635106e taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.427433] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.427510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.427652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.427723] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1520d4fa-edba-41bd-8755-7e34c635106e',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.428659] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.428772] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.428860] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.429036] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.429109] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a2ad9fb-edc6-4825-9f05-2a041fddcce1',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.429782] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b73d257-772b-49ed-a193-0adc505752e2 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.429909] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.429981] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.430143] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.430209] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b73d257-772b-49ed-a193-0adc505752e2',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.430930] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.431054] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.431116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.431281] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.431408] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f5b8858-9649-4891-ac8f-4f6a330e3a51',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.432057] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6428cece-54ff-401f-affd-cd4584d1d303 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.432239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.432314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.432474] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.432548] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6428cece-54ff-401f-affd-cd4584d1d303',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.433250] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00293097-1dd1-4554-8c94-171a92644c52 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.433362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.433426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.433571] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.433642] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00293097-1dd1-4554-8c94-171a92644c52',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.434388] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e916b5-2321-4083-a362-4d91a75f9d62 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.434500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.434557] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.434711] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.434817] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e916b5-2321-4083-a362-4d91a75f9d62',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.475956] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.476216] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.476264] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.476506] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.478705] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.478845] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.479777] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.479912] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.480911] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.481082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.481942] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.482078] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.482976] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.483113] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.484030] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.484155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.500624] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.500805] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4f3999-c21c-4125-ba57-29d87cf22d79 is going to be deleted. [ 1545.501615] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.501818] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.524425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.524632] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f85b08-83ad-443d-9e32-5acb05ba6b8e is going to be deleted. [ 1545.525356] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.525558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.544249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.544406] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0282ecb1-21b7-414b-a78b-410dac72d851 is going to be deleted. [ 1545.545283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.545484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.560787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.560998] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.566852] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.567035] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e916b5-2321-4083-a362-4d91a75f9d62 is going to be deleted. [ 1545.567873] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.568098] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.579466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.579638] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.586099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.586250] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b22e932-32d8-43d0-87bb-f6563236db76 is going to be deleted. [ 1545.587452] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.587665] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.605927] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.606108] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29974051-cea6-4575-91c9-c21beee8c912 is going to be deleted. [ 1545.607049] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.607283] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.617401] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.617574] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.649868] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.650161] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.651081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.651209] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39207596-4602-4c59-b143-d5038ebffb91 is going to be deleted. [ 1545.652260] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.652379] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.652423] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.652519] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4f3999-c21c-4125-ba57-29d87cf22d79" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.652667] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.652817] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.652897] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.653053] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f85b08-83ad-443d-9e32-5acb05ba6b8e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.653600] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.653787] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.653871] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.653987] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0282ecb1-21b7-414b-a78b-410dac72d851" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.654128] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.654271] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.654347] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.654446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e916b5-2321-4083-a362-4d91a75f9d62" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.660953] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.661082] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.661151] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.661311] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.661392] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.661500] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b22e932-32d8-43d0-87bb-f6563236db76" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.692841] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.693114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.693114] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.693317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.693415] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.693539] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29974051-cea6-4575-91c9-c21beee8c912" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.729950] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.730175] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.730218] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.730421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.730513] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.730630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39207596-4602-4c59-b143-d5038ebffb91" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.939150] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.939429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.939429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.939616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.939790] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.939887] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.939967] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.940170] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.940245] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.940334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.940426] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.941958] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.942112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.942197] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.942339] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.943730] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.943848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.944490] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.944594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.949414] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.949607] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.969726] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.969936] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.970683] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.970806] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.975296] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.975446] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.976095] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.976228] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.976886] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.976993] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.977642] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.977762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.978410] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.978501] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.979229] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.979324] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.980066] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.980188] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6 is going to be deleted. [ 1545.981014] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.981221] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.999652] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.999794] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1cc7026-1d45-4ec0-a32d-311a913b774a is going to be deleted. [ 1546.000885] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.001214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.029382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.029561] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3 is going to be deleted. [ 1546.030510] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.030720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.051685] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.051895] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.061429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.061682] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97be36bb-9aa7-4ca4-9b9b-f2f13467259b is going to be deleted. [ 1546.062594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.062807] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.064188] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.064307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.081015] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.081198] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.084838] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.085029] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1520d4fa-edba-41bd-8755-7e34c635106e is going to be deleted. [ 1546.086348] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.086577] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.139630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.139834] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af0234d8-5fb6-4559-8321-eb1748c80ba1 is going to be deleted. [ 1546.140720] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.140925] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.142359] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.142537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.179295] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.179483] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00293097-1dd1-4554-8c94-171a92644c52 is going to be deleted. [ 1546.180418] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.180640] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.182038] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.182162] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.260648] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.260838] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6428cece-54ff-401f-affd-cd4584d1d303 is going to be deleted. [ 1546.262717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.262937] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.279974] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.280210] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.313970] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.314176] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a2ad9fb-edc6-4825-9f05-2a041fddcce1 is going to be deleted. [ 1546.315270] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.315520] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.326336] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.326560] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.377429] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.377630] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5232ce03-a604-4502-9f49-52193de2ebe8 is going to be deleted. [ 1546.378515] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.378731] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.422339] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.422755] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.437407] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.437620] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b73d257-772b-49ed-a193-0adc505752e2 is going to be deleted. [ 1546.438492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.438717] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.451560] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.470122] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.470313] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.476645] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.476829] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f5b8858-9649-4891-ac8f-4f6a330e3a51 is going to be deleted. [ 1546.478241] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.478468] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.478563] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.478691] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdc0b3ee-d763-4c3d-94d2-0a42ac5ad0a6" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.478843] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.479038] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.479169] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.479310] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1cc7026-1d45-4ec0-a32d-311a913b774a" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.479881] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.480104] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.480193] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.480307] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e07d8d7-e4c8-459f-9a2c-2d54eafe54f3" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.480435] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.480581] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.480657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.480767] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97be36bb-9aa7-4ca4-9b9b-f2f13467259b" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.480891] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.481039] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.481133] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.481247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1520d4fa-edba-41bd-8755-7e34c635106e" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.481342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.481477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.481543] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.481657] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af0234d8-5fb6-4559-8321-eb1748c80ba1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.481795] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.481940] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.482020] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.482167] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00293097-1dd1-4554-8c94-171a92644c52" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.482304] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.482459] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.482569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.482727] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6428cece-54ff-401f-affd-cd4584d1d303" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.482878] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.483033] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.483140] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.483240] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a2ad9fb-edc6-4825-9f05-2a041fddcce1" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.585819] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.586062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.586062] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.586239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.586334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.586456] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5232ce03-a604-4502-9f49-52193de2ebe8" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.597133] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.597334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.597334] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.597538] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.597631] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.597752] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b73d257-772b-49ed-a193-0adc505752e2" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.608852] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.609048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.609048] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.609247] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.609338] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.609447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f5b8858-9649-4891-ac8f-4f6a330e3a51" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.953979] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 656cb5a0-018b-4c85-98d9-26ec41583250: rpc.has_security_group_logging(os_id): False [ 1546.971909] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.972155] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.972211] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.972391] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.990892] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.991211] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.991355] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.991422] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.991613] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.991695] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.991784] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1547.051787] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.052035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.052035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.052258] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.052410] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.066336] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1549.084088] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1549.084381] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.408721] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.408721] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.173846] env[69255]: INFO networking_nsxv3.common.synchronization [req-a89436cd-8d87-4140-97dc-704293db01a6 req-9a483916-dab2-4f97-87e0-da9e25531dcf tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1552.174430] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1552.174749] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.174868] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.174934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.175156] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.175326] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.175425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.175488] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.175630] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.175712] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.175802] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.678619] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.678841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.678841] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.678995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.679099] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.679298] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.679421] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.679558] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.679605] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.679677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.679809] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1552.712261] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.712528] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.712643] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.712965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.713215] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.722381] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1554.733073] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1554.733537] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 deletion is rescheduled due to dependency. [ 1554.733537] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.175636] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.176091] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.321472] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f07a9a1-7c67-41a9-b082-6047039a233f req-6837196a-225b-46ee-9c70-7d4b7f78c1c6 tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1560.321961] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1560.322283] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.322447] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.322490] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.322683] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.322836] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.322934] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.322995] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.323214] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.323282] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.323372] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.579129] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.579338] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.579481] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.579755] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.580026] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.580186] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.580305] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.580512] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.580690] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.580909] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1560.581370] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1560.581533] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1560.581657] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1560.581775] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1560.581889] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1560.582161] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1560.603451] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1560.603666] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1560.603792] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1560.603983] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.604306] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-9ea45de3-1908-4d93-9770-3ba42d87e1ea taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.604479] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.604602] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.604928] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.605081] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea45de3-1908-4d93-9770-3ba42d87e1ea',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.825967] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.826208] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.826257] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.826436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.826527] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.826725] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.826820] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.826882] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.827035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.827112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.827202] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1560.851937] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.852195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.852195] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.852317] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.852464] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.862343] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1561.108119] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.108119] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.108389] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.108497] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.108623] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.108785] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Segment Port 9ea45de3-1908-4d93-9770-3ba42d87e1ea not found, creating... [ 1561.109055] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.109220] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.109340] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.109566] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.109709] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.109996] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.110171] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.110291] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.110531] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.110687] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.110834] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea is going to be created. [ 1561.131419] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.131652] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.131703] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.131972] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.132252] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.132535] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.009182] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f07a9a1-7c67-41a9-b082-6047039a233f req-01479e2d-a27b-4761-923b-d1fa1023199a service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1562.009490] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f07a9a1-7c67-41a9-b082-6047039a233f req-01479e2d-a27b-4761-923b-d1fa1023199a service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1562.009490] env[69255]: INFO networking_nsxv3.common.synchronization [req-8f07a9a1-7c67-41a9-b082-6047039a233f req-01479e2d-a27b-4761-923b-d1fa1023199a service nova] Enqueued Resource ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea with Priority: HIGHEST for action port [ 1562.009767] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1562.009899] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1562.009995] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea with Priority: HIGHEST for action port [ 1562.010540] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.010684] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.010754] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.010954] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.011773] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.013010] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.013116] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.013322] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ea45de3-1908-4d93-9770-3ba42d87e1ea taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.013414] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.013481] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.013677] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.014741] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea45de3-1908-4d93-9770-3ba42d87e1ea',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.516753] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.516924] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.517252] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ea45de3-1908-4d93-9770-3ba42d87e1ea with status ACTIVE [ 1562.517252] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.517411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.517411] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.517592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.517682] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.517851] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.517946] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.518018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.518164] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.518239] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.518418] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.518509] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.518569] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.518707] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.518781] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.518865] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea is going to be updated. [ 1562.541194] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.541426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.541426] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.541594] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.541728] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.541884] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.872293] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1562.872500] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 deletion is rescheduled due to dependency. [ 1562.872575] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.872809] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.873042] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.873228] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.873342] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.873401] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.873555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.873639] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.873757] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.376358] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.878657] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.381993] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.382507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.382507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.382507] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.382718] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.382718] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1564.413008] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.413220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.413220] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.413449] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.413629] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.423012] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1566.434050] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1566.434050] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.434492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.434492] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.434492] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.434635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.434635] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.434796] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.434848] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.434932] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.435079] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.938072] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.010837] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.011055] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1567.440875] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 656cb5a0-018b-4c85-98d9-26ec41583250: rpc.has_security_group_logging(os_id): False [ 1567.458459] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.458668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.458668] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.458875] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.458965] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.459232] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.459332] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.459393] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.459542] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.459616] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.459702] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1567.519019] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.519266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.519266] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.519469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.519612] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.534761] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1569.551788] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1569.552196] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.012192] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.012548] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.013387] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.013827] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.014834] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.014834] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.016482] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1587.016482] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1592.017329] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.017738] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.018860] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1597.019416] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1602.020025] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.020405] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.021396] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.021802] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.022769] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.023258] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.024550] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.024550] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.025264] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.025638] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.025946] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1627.026255] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1632.027416] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1632.027786] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1632.975245] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.975470] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.975592] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.975863] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.976168] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.976354] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.976484] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.976711] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.976861] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.977086] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1632.977199] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] NeedRegenerationException {{(pid=69255) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1632.977319] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] no value, waiting for create lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1632.977425] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] value creation lock acquired {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1632.977570] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] No value present for key: 'zone-id' {{(pid=69255) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1632.977684] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Calling creation function for not-yet-present value {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1632.977819] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1633.003782] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1633.004016] env[69255]: DEBUG dogpile.cache.region [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69255) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1633.004090] env[69255]: DEBUG dogpile.lock [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Released creation lock {{(pid=69255) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1633.004276] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "network-821" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.004713] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock port-9ea45de3-1908-4d93-9770-3ba42d87e1ea taken with stack trace [, , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.004989] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.005231] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.005620] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.005829] env[69255]: DEBUG networking_nsxv3.api.rpc [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea45de3-1908-4d93-9770-3ba42d87e1ea',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1633.508065] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.508374] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.508454] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.508746] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.508907] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.509213] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.509388] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.509512] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.509734] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.509879] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.510200] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.510415] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.510545] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.510757] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.510900] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.511062] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Resource: SegmentPort with ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea is going to be updated. [ 1633.532574] env[69255]: DEBUG networking_nsxv3.common.locking [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1633.532805] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1633.532910] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1633.533208] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1633.533413] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1633.533638] env[69255]: DEBUG oslo_concurrency.lockutils [None req-555e0ea1-b9c4-4b3d-ba1b-784a50524bd6 None None] Releasing lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.193377] env[69255]: INFO networking_nsxv3.common.synchronization [req-2452ae3b-10be-45f4-b1b9-a3d9fc48cf85 req-ca2d24a3-68c4-4260-96e9-03c76e6f6625 service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1634.193598] env[69255]: INFO networking_nsxv3.common.synchronization [req-2452ae3b-10be-45f4-b1b9-a3d9fc48cf85 req-ca2d24a3-68c4-4260-96e9-03c76e6f6625 service nova] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1634.193890] env[69255]: INFO networking_nsxv3.common.synchronization [req-2452ae3b-10be-45f4-b1b9-a3d9fc48cf85 req-ca2d24a3-68c4-4260-96e9-03c76e6f6625 service nova] Enqueued Resource ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea with Priority: HIGHEST for action port [ 1634.194311] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_rules [ 1634.194477] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1634.194580] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea with Priority: HIGHEST for action port [ 1634.194865] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.194989] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.195065] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.195309] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.195423] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.196244] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.196354] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.196425] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.196599] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.196740] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.196853] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.196915] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.197085] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.197172] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.197264] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.198037] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ea45de3-1908-4d93-9770-3ba42d87e1ea taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.198145] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.198206] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.198523] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.198523] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea45de3-1908-4d93-9770-3ba42d87e1ea',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.700191] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1634.701253] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.701361] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.702815] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ea45de3-1908-4d93-9770-3ba42d87e1ea with status ACTIVE [ 1634.702984] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.703109] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.703166] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.703363] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.703477] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.703693] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.703802] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.703857] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.704035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.704112] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.704293] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.704382] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.704442] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.704572] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.704642] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.704724] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ea45de3-1908-4d93-9770-3ba42d87e1ea is going to be updated. [ 1634.726559] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.726733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.726766] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.726979] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.727081] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.727232] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ea45de3-1908-4d93-9770-3ba42d87e1ea" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.202326] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1635.705274] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.705670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.705670] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.705742] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.705905] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.705983] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1635.742420] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.742579] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.742674] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.742850] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.743035] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.752314] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1637.763146] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1637.763733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.763733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.763733] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.763933] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.764045] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.764105] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.764249] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.764328] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.764408] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.764502] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1638.267453] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1638.770648] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 656cb5a0-018b-4c85-98d9-26ec41583250: rpc.has_security_group_logging(os_id): False [ 1638.790142] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.790436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.790436] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.790649] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.790759] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.791046] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.791204] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.791284] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.791484] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.791566] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.791658] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1638.856793] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1638.857073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1638.857073] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1638.857314] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1638.857469] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1638.870205] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1639.195249] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.195463] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1640.888478] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1640.888757] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.196853] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.197254] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.198121] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.198512] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.459065] env[69255]: INFO networking_nsxv3.common.synchronization [req-abbc7727-8471-4947-961a-295a27c5b7ef req-2fc583c8-fae6-4f0b-9a75-01ea798be241 tempest-ServerActionsTestOtherB-541759439 tempest-ServerActionsTestOtherB-541759439-project-member] Enqueued Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1650.459591] env[69255]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656cb5a0-018b-4c85-98d9-26ec41583250 with Priority: HIGHEST for action security_group_members [ 1650.459893] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock member-656cb5a0-018b-4c85-98d9-26ec41583250 taken with stack trace [, , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.460029] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.460097] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.460291] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.460466] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.460541] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.460592] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.461476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.461476] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.461476] env[69255]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('656cb5a0-018b-4c85-98d9-26ec41583250',) {} {{(pid=69255) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1650.962798] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.963043] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.963090] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.963320] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.963405] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.963594] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.963706] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.963773] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.963931] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.964018] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.964116] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 is going to be updated. [ 1650.996161] env[69255]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69255) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1650.996362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1650.996362] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1650.996555] env[69255]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1650.996686] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.006487] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: IN_PROGRESS for 2s [ 1653.017382] env[69255]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 656cb5a0-018b-4c85-98d9-26ec41583250 in Status: SUCCESS [ 1653.017762] env[69255]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 656cb5a0-018b-4c85-98d9-26ec41583250 deletion is rescheduled due to dependency. [ 1653.017762] env[69255]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-656cb5a0-018b-4c85-98d9-26ec41583250" {{(pid=69255) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.460960] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.461344] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.462415] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.462778] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.463510] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.463860] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.465011] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.465382] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1675.466281] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1675.466730] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1680.467746] env[69255]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1680.468100] env[69255]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0